[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:16 dist-test-slave-0kls krb5kdc[17943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:16 dist-test-slave-0kls krb5kdc[17943](info): set up 2 sockets
Aug 11 01:37:16 dist-test-slave-0kls krb5kdc[17943](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 01:37:17.332186 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:17 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:17.536651 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35549
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:35549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:17.889703 17958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:17.890092 17958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:17.890199 17958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:17.897723 17958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:17.897889 17958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:17.897940 17958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:17.898000 17958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:17.898047 17958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:17.909266 17958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:35549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:17.910789 17958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:17.912218 17958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:17.925827 17963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:17.925751 17964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:17.926100 17966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:17.927083 17958 server_base.cc:1034] running on GCE node
I20260811 01:37:17.927968 17958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:17.929563 17958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:17.930821 17958 hybrid_clock.cc:648] HybridClock initialized: now 1786412237930788 us; error 128 us; skew 500 ppm
I20260811 01:37:17.931301 17958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:17 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412237, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:17.935256 17958 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:17.937062 17958 webserver.cc:460] Webserver started at http://127.17.132.62:34911/ using document root <none> and password file <none>
I20260811 01:37:17.937975 17958 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:17.938136 17958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:17.938508 17958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:17.942173 17958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e4923a17b1ff44a789e6be39659f30ee"
format_stamp: "Formatted at 2026-08-11 01:37:17 on dist-test-slave-0kls"
server_key: "7c9eaac7d7465ad7ebebc716f649cf0c"
server_key_iv: "a20b84101f7faaa2fbdf7bd94d3e3a29"
server_key_version: "encryptionkey@0"
I20260811 01:37:17.943070 17958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e4923a17b1ff44a789e6be39659f30ee"
format_stamp: "Formatted at 2026-08-11 01:37:17 on dist-test-slave-0kls"
server_key: "7c9eaac7d7465ad7ebebc716f649cf0c"
server_key_iv: "a20b84101f7faaa2fbdf7bd94d3e3a29"
server_key_version: "encryptionkey@0"
I20260811 01:37:17.949023 17958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:37:17.952970 17973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:17.954582 17958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:17.954905 17958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e4923a17b1ff44a789e6be39659f30ee"
format_stamp: "Formatted at 2026-08-11 01:37:17 on dist-test-slave-0kls"
server_key: "7c9eaac7d7465ad7ebebc716f649cf0c"
server_key_iv: "a20b84101f7faaa2fbdf7bd94d3e3a29"
server_key_version: "encryptionkey@0"
I20260811 01:37:17.955176 17958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:17.968739 17958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:17.974136 17958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:17.974464 17958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:17.994683 17958 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:35549
I20260811 01:37:17.994696 18025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:35549 every 8 connection(s)
I20260811 01:37:17.996207 17958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:17.998035 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 17958
I20260811 01:37:17.998359 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:18.000406 17936 external_mini_cluster.cc:1428] Setting key 56b480edfd6c70fdc1c1ed3cdc63e526
I20260811 01:37:18.000837 18026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:18.016086 18026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee: Bootstrap starting.
I20260811 01:37:18.019549 18026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:18.020792 18026 log.cc:824] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:18.023862 18026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee: No bootstrap required, opened a new log
I20260811 01:37:18.031654 18026 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } }
I20260811 01:37:18.032085 18026 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:18.032210 18026 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4923a17b1ff44a789e6be39659f30ee, State: Initialized, Role: FOLLOWER
I20260811 01:37:18.032832 18026 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } }
I20260811 01:37:18.033094 18026 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:18.033249 18026 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:18.033432 18026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 0 FOLLOWER]: Advancing to term 1
Aug 11 01:37:18 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:18.035904 18026 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } }
I20260811 01:37:18.036639 18026 leader_election.cc:302] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4923a17b1ff44a789e6be39659f30ee; no voters:
I20260811 01:37:18.037555 18026 leader_election.cc:288] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:18.037650 18031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:18.040002 18031 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [term 1 LEADER]: Becoming Leader. State: Replica: e4923a17b1ff44a789e6be39659f30ee, State: Running, Role: LEADER
I20260811 01:37:18.040450 18026 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:18.040688 18031 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } }
I20260811 01:37:18.045310 18032 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4923a17b1ff44a789e6be39659f30ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } } }
I20260811 01:37:18.045727 18032 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:18.049283 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:18.007011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49682 (local address 127.17.132.62:35549)
0811 01:37:18.009909 (+ 2898us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:18.009930 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:18.010487 (+ 557us) server_negotiation.cc:407] Connection header received
0811 01:37:18.020781 (+ 10294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:18.020805 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:18.021321 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:18.021765 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:18.024999 (+ 3234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.026484 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.028225 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.028999 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.029248 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:18.035552 (+ 6304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:18.035562 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:18.035577 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:18.035627 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:18.039563 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:18.040691 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:18.040701 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:18.040710 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:18.040968 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:18.041490 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:18.041496 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:18.041500 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:18.042500 (+ 1000us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:18.043047 (+ 547us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:18.046813 (+ 3766us) server_negotiation.cc:299] Negotiation successful
0811 01:37:18.047431 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2585,"thread_start_us":3023,"threads_started":1}
I20260811 01:37:18.050411 18033 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4923a17b1ff44a789e6be39659f30ee. Latest consensus state: current_term: 1 leader_uuid: "e4923a17b1ff44a789e6be39659f30ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4923a17b1ff44a789e6be39659f30ee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35549 } } }
I20260811 01:37:18.050804 18033 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:18.056178 18042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:18.062098 18042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:18.072045 18042 catalog_manager.cc:1347] Generated new cluster ID: f237ab6cde784affbed3de53c5497149
I20260811 01:37:18.072208 18042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:18.107550 18042 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:18.109567 18042 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:18.121196 18042 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4923a17b1ff44a789e6be39659f30ee: Generated new TSK 0
I20260811 01:37:18.122220 18042 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:18.185393 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:18.553443 18053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:18.553848 18053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:18.553987 18053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:18.562269 18053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:18.562402 18053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:18.562570 18053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:18.573251 18053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:18.574692 18053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:18.576025 18053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:18.590423 18058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:18.590396 18059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:18.590456 18061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:18.591614 18053 server_base.cc:1034] running on GCE node
I20260811 01:37:18.592281 18053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:18.593359 18053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:18.594579 18053 hybrid_clock.cc:648] HybridClock initialized: now 1786412238594532 us; error 31 us; skew 500 ppm
I20260811 01:37:18.594883 18053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:18 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412238, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:18.598323 18053 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:18.599920 18053 webserver.cc:460] Webserver started at http://127.17.132.1:45267/ using document root <none> and password file <none>
I20260811 01:37:18.600729 18053 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:18.600875 18053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:18.601244 18053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:18.604677 18053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "f8eb5e208b294a9ca884ee4900f75a40"
format_stamp: "Formatted at 2026-08-11 01:37:18 on dist-test-slave-0kls"
server_key: "e8eeea0e1b1a33f81c72a1ad13e98875"
server_key_iv: "c97e2a153a238cd57a47a24cd7bcf5a2"
server_key_version: "encryptionkey@0"
I20260811 01:37:18.605688 18053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "f8eb5e208b294a9ca884ee4900f75a40"
format_stamp: "Formatted at 2026-08-11 01:37:18 on dist-test-slave-0kls"
server_key: "e8eeea0e1b1a33f81c72a1ad13e98875"
server_key_iv: "c97e2a153a238cd57a47a24cd7bcf5a2"
server_key_version: "encryptionkey@0"
I20260811 01:37:18.611965 18053 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 01:37:18.616343 18068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:18.617969 18053 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:18.618149 18053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "f8eb5e208b294a9ca884ee4900f75a40"
format_stamp: "Formatted at 2026-08-11 01:37:18 on dist-test-slave-0kls"
server_key: "e8eeea0e1b1a33f81c72a1ad13e98875"
server_key_iv: "c97e2a153a238cd57a47a24cd7bcf5a2"
server_key_version: "encryptionkey@0"
I20260811 01:37:18.618363 18053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:18.643674 18053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:18.648602 18053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:18.648891 18053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:18.650012 18053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:18.651510 18053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:18.651592 18053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:18.651685 18053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:18.651731 18053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:18.687014 18053 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:39871
I20260811 01:37:18.687067 18186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:39871 every 8 connection(s)
I20260811 01:37:18.688536 18053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:18.690732 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18053
I20260811 01:37:18.690972 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:18.691670 17936 external_mini_cluster.cc:1428] Setting key c2c4c024313019d236588b8739c3a25f
Aug 11 01:37:18 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412238, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:18.715199 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:18.692187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:53427 (local address 127.17.132.62:35549)
0811 01:37:18.692769 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:18.692777 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:18.694067 (+ 1290us) server_negotiation.cc:407] Connection header received
0811 01:37:18.696177 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:18.696182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:18.696279 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:18.696404 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:18.698208 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.698960 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.701410 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.701936 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.702065 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:18.707077 (+ 5012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:18.707088 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:18.707096 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:18.707163 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:18.711136 (+ 3973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:18.712168 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:18.712177 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:18.712185 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:18.712372 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:18.712976 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:18.712985 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:18.712992 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:18.713469 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:18.713656 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:18.714642 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 01:37:18.714898 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":288,"threads_started":1}
I20260811 01:37:18.716420 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:18.692859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35549 (local address 127.17.132.1:53427)
0811 01:37:18.693904 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:18.693959 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:18.695855 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:18.696685 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:18.696695 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:18.697265 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:18.697996 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:18.698018 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.699162 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.699166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:18.701167 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:18.701186 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:18.702220 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:18.702230 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:18.702619 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:18.703468 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:18.703507 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:18.706746 (+ 3239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:18.711371 (+ 4625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:18.711382 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:18.711399 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:18.711980 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:18.712576 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:18.712581 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:18.712583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:18.712818 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:18.713686 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:18.713696 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:18.714163 (+ 467us) client_negotiation.cc:769] Sending connection context
0811 01:37:18.714439 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 01:37:18.715053 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":415,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:37:18.718473 18187 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35549
I20260811 01:37:18.718885 18187 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:18.719946 18187 heartbeater.cc:511] Master 127.17.132.62:35549 requested a full tablet report, sending...
I20260811 01:37:18.722543 17991 ts_manager.cc:194] Registered new tserver with Master: f8eb5e208b294a9ca884ee4900f75a40 (127.17.132.1:39871)
I20260811 01:37:18.724864 17991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:53427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:18.745479 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:19.117902 18193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:19.118351 18193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:19.118520 18193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:19.126713 18193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:19.126888 18193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:19.127069 18193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:19.137655 18193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:19.139135 18193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:19.140594 18193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:19.155138 18200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:19.155102 18199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:19.155299 18202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:19.156041 18193 server_base.cc:1034] running on GCE node
I20260811 01:37:19.156734 18193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:19.157776 18193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:19.159101 18193 hybrid_clock.cc:648] HybridClock initialized: now 1786412239159038 us; error 49 us; skew 500 ppm
I20260811 01:37:19.159530 18193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:19.163177 18193 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:19.164899 18193 webserver.cc:460] Webserver started at http://127.17.132.2:43651/ using document root <none> and password file <none>
I20260811 01:37:19.165685 18193 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:19.165887 18193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:19.166250 18193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:19.169453 18193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "208f485557004152816d763035c54ac6"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "0c663080403380e5f9af2b8e413515c4"
server_key_iv: "e2472e5f51e49d210eb9e4558c746e5c"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.170457 18193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "208f485557004152816d763035c54ac6"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "0c663080403380e5f9af2b8e413515c4"
server_key_iv: "e2472e5f51e49d210eb9e4558c746e5c"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.176342 18193 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:37:19.180415 18210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.182088 18193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:19.182301 18193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "208f485557004152816d763035c54ac6"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "0c663080403380e5f9af2b8e413515c4"
server_key_iv: "e2472e5f51e49d210eb9e4558c746e5c"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.182538 18193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:19.198896 18193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:19.203476 18193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:19.203802 18193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:19.204881 18193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:19.206367 18193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:19.206475 18193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.206646 18193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:19.206748 18193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.244916 18193 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:38425
I20260811 01:37:19.245012 18327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:38425 every 8 connection(s)
I20260811 01:37:19.246474 18193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:19.247777 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18193
I20260811 01:37:19.248009 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:19.248572 17936 external_mini_cluster.cc:1428] Setting key 264c1aaa6a19aacfd38501a46b1f3fee
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:37:19.271168 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.249695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:40203 (local address 127.17.132.62:35549)
0811 01:37:19.252257 (+ 2562us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:19.252264 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:19.252289 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:37:19.253814 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:19.253822 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:19.253917 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:19.254047 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:19.255705 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.256471 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.258568 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.259037 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.259147 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.263761 (+ 4614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:19.263767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:19.263770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:19.263809 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:19.267420 (+ 3611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.268398 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.268406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.268412 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.268613 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.269107 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.269113 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.269117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.269596 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:19.269777 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:19.270691 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 01:37:19.270882 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2432,"thread_start_us":4155,"threads_started":1}
I20260811 01:37:19.272279 18331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.250373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35549 (local address 127.17.132.2:40203)
0811 01:37:19.251432 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:19.251494 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:19.253469 (+ 1975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:19.254324 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:19.254334 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:19.254891 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:19.255518 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:19.255536 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.256646 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.256650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:19.258398 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:19.258417 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.259299 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.259309 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:19.259701 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.260518 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:19.260552 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:19.263475 (+ 2923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:19.267624 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:19.267632 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:19.267647 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:19.268225 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:19.268745 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:19.268749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:19.268751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:19.268968 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:19.269757 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:19.269764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:19.270239 (+ 475us) client_negotiation.cc:769] Sending connection context
0811 01:37:19.270561 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 01:37:19.271010 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":477,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
I20260811 01:37:19.274052 18328 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35549
I20260811 01:37:19.274420 18328 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:19.275345 18328 heartbeater.cc:511] Master 127.17.132.62:35549 requested a full tablet report, sending...
I20260811 01:37:19.277033 17991 ts_manager.cc:194] Registered new tserver with Master: 208f485557004152816d763035c54ac6 (127.17.132.2:38425)
I20260811 01:37:19.277992 17991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:40203
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:19.301151 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:19.675806 18334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:19.676136 18334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:19.676312 18334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:19.684146 18334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:19.684361 18334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:19.684507 18334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:19.697880 18334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35549
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:19.699256 18334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:19.700630 18334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:19.715209 18339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:19.715191 18340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:19.715271 18342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:19.716521 18334 server_base.cc:1034] running on GCE node
I20260811 01:37:19.717231 18334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:19.718492 18334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:19.719811 18334 hybrid_clock.cc:648] HybridClock initialized: now 1786412239719706 us; error 62 us; skew 500 ppm
I20260811 01:37:19.720173 18334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:19.723819 18334 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:19.725524 18334 webserver.cc:460] Webserver started at http://127.17.132.3:40595/ using document root <none> and password file <none>
I20260811 01:37:19.726367 18334 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:19.726527 18334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:19.726876 18334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:19.728356 18187 heartbeater.cc:503] Master 127.17.132.62:35549 was elected leader, sending a full tablet report...
I20260811 01:37:19.730753 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "7a1ec66495b14026bb8668d112316655"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "6cb96be66c6a6502f6869fc01b4b23c4"
server_key_iv: "e7883ac67571c1e4f178d91a735793f1"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.731595 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "7a1ec66495b14026bb8668d112316655"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "6cb96be66c6a6502f6869fc01b4b23c4"
server_key_iv: "e7883ac67571c1e4f178d91a735793f1"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.737367 18334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:37:19.741333 18349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.743013 18334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:37:19.743242 18334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "7a1ec66495b14026bb8668d112316655"
format_stamp: "Formatted at 2026-08-11 01:37:19 on dist-test-slave-0kls"
server_key: "6cb96be66c6a6502f6869fc01b4b23c4"
server_key_iv: "e7883ac67571c1e4f178d91a735793f1"
server_key_version: "encryptionkey@0"
I20260811 01:37:19.743495 18334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:19.777978 18334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:19.782480 18334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:19.782807 18334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:19.783885 18334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:19.785320 18334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:19.785429 18334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.785583 18334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:19.785665 18334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:19.825343 18334 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:34901
I20260811 01:37:19.825388 18467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:34901 every 8 connection(s)
I20260811 01:37:19.826846 18334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:19.827503 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18334
I20260811 01:37:19.827749 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:19.828325 17936 external_mini_cluster.cc:1428] Setting key 469341cc46404f28dcacb5ea316109ee
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:19.849328 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.830498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40103 (local address 127.17.132.62:35549)
0811 01:37:19.831030 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:19.831036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:19.832140 (+ 1104us) server_negotiation.cc:407] Connection header received
0811 01:37:19.834438 (+ 2298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:19.834442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:19.834510 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:19.834608 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:19.836131 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.836929 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.838643 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.839061 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.839194 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.842938 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:19.842944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:19.842947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:19.842984 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:19.846103 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.846932 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.846937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.846939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.847065 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.847535 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.847539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.847541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.847888 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:19.848010 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:19.848868 (+ 858us) server_negotiation.cc:299] Negotiation successful
0811 01:37:19.849041 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":256,"threads_started":1}
I20260811 01:37:19.850538 18471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.831109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35549 (local address 127.17.132.3:40103)
0811 01:37:19.831971 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:19.832024 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:19.834098 (+ 2074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:19.834831 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:19.834839 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:19.835391 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:19.835979 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:19.835997 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.837067 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.837071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:19.838502 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:19.838516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.839277 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.839282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:19.839492 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.840151 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:19.840174 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:19.842719 (+ 2545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:19.846268 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:19.846278 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:19.846299 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:19.846815 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:19.847182 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:19.847186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:19.847188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:19.847436 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:19.847996 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:19.848002 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:19.848431 (+ 429us) client_negotiation.cc:769] Sending connection context
0811 01:37:19.848704 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 01:37:19.849123 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":391,"threads_started":1}
I20260811 01:37:19.851924 18468 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35549
I20260811 01:37:19.852262 18468 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:19.853044 18468 heartbeater.cc:511] Master 127.17.132.62:35549 requested a full tablet report, sending...
I20260811 01:37:19.854646 17991 ts_manager.cc:194] Registered new tserver with Master: 7a1ec66495b14026bb8668d112316655 (127.17.132.3:34901)
I20260811 01:37:19.855502 17991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:40103
I20260811 01:37:19.859367 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:19.921193 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.904625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38488 (local address 127.17.132.1:39871)
0811 01:37:19.905359 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:19.905366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:19.905394 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:37:19.905461 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:19.905468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:19.905693 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:19.905945 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:19.907387 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.908570 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.910006 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.910595 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.910756 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.915092 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:19.915105 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:19.915121 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:19.915165 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:19.918132 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.918864 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.918873 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.918875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.919018 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.919431 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.919436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.919472 (+ 36us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.919870 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:19.920202 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:19.920531 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 01:37:19.920826 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":410,"threads_started":1}
W20260811 01:37:19.922590 18100 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38488
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:37:19 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:19.977169 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.962611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.17.132.1:39871)
0811 01:37:19.962924 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:19.962931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:19.963267 (+ 336us) server_negotiation.cc:407] Connection header received
0811 01:37:19.963468 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:19.963473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:19.963540 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:19.963646 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:19.965097 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.965858 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.967113 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.967542 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.967676 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.972193 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:19.972199 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:19.972203 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:19.972244 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:19.974969 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.975619 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.975623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.975625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.975768 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.976077 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.976080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.976082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.976328 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:19.976516 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:19.976768 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 01:37:19.976942 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:37:19.978812 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18053
I20260811 01:37:19.992774 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:19.979847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38516 (local address 127.17.132.1:39871)
0811 01:37:19.980016 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:19.980020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:19.980386 (+ 366us) server_negotiation.cc:407] Connection header received
0811 01:37:19.980504 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:19.980507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:19.980565 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:19.980649 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:19.981926 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.982622 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.983964 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:19.984413 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:19.984511 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:19.987079 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:19.987084 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:19.987087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:19.987125 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:19.990070 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.990903 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.990908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.990910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.991058 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:19.991453 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:19.991457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:19.991459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:19.991763 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:19.991962 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:19.992296 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 01:37:19.992487 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 01:37:19.993575 18182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:20.084797 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18053
I20260811 01:37:20.106006 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18193
Aug 11 01:37:20 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:20.123049 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:20.107022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52252 (local address 127.17.132.2:38425)
0811 01:37:20.107633 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:20.107640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:20.107667 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:37:20.107730 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:20.107736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:20.107948 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:20.108085 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:20.109502 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:20.110742 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:20.112004 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:20.112579 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:20.112689 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:20.116907 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:20.116921 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:20.116937 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:20.116977 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:20.120156 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:20.120925 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:20.120933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:20.120935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:20.121064 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:20.121433 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:20.121436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:20.121438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:20.121864 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:20.122103 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:20.122399 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 01:37:20.122613 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":340,"threads_started":1}
I20260811 01:37:20.124503 18323 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:20.210676 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18193
I20260811 01:37:20.231889 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18334
Aug 11 01:37:20 dist-test-slave-0kls krb5kdc[17943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:20.249632 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:20.232928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58128 (local address 127.17.132.3:34901)
0811 01:37:20.233525 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:20.233533 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:20.233561 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:37:20.233644 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:20.233651 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:20.233940 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:20.234071 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:20.235433 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:20.236550 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:20.237987 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:20.238612 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:20.238743 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:20.243249 (+ 4506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:20.243264 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:20.243280 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:20.243321 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:20.246582 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:20.247468 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:20.247477 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:20.247479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:20.247614 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:20.248004 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:20.248007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:20.248009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:20.248406 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:20.248668 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:20.248959 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:37:20.249199 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":281,"threads_started":1}
I20260811 01:37:20.251178 18463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:20.337054 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18334
I20260811 01:37:20.360491 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 17958
I20260811 01:37:20.361881 18021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:20.471779 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 17958
2026-08-11T01:37:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4338 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:20 dist-test-slave-0kls krb5kdc[18491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:20 dist-test-slave-0kls krb5kdc[18491](info): set up 2 sockets
Aug 11 01:37:20 dist-test-slave-0kls krb5kdc[18491](info): commencing operation
krb5kdc: starting...
W20260811 01:37:21.610877 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:21 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:21.829945 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46433
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:46433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:22.178448 18505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:22.178810 18505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:22.178962 18505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:22.186568 18505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:22.186728 18505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:22.186828 18505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:22.186929 18505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:22.187003 18505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:22.197430 18505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:46433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:22.198885 18505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:22.200383 18505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:22.212896 18511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:22.212972 18513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:22.213063 18510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:22.214756 18505 server_base.cc:1034] running on GCE node
I20260811 01:37:22.215622 18505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:22.217170 18505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:22.218406 18505 hybrid_clock.cc:648] HybridClock initialized: now 1786412242218346 us; error 56 us; skew 500 ppm
I20260811 01:37:22.218783 18505 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:22 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:22.227517 18505 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:22.229303 18505 webserver.cc:460] Webserver started at http://127.17.132.62:42709/ using document root <none> and password file <none>
I20260811 01:37:22.230160 18505 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:22.230326 18505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:22.230676 18505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:22.234032 18505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "4f3caa10e70045e581007a639c4da7a7"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "cb4c2887f66c22304e09e96f59c00743"
server_key_iv: "7bf1574ca4ee4934e7870034ea1c097f"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.234879 18505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "4f3caa10e70045e581007a639c4da7a7"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "cb4c2887f66c22304e09e96f59c00743"
server_key_iv: "7bf1574ca4ee4934e7870034ea1c097f"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.240504 18505 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:37:22.244210 18521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:22.245602 18505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:37:22.245841 18505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "4f3caa10e70045e581007a639c4da7a7"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "cb4c2887f66c22304e09e96f59c00743"
server_key_iv: "7bf1574ca4ee4934e7870034ea1c097f"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.246124 18505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:22.258092 18505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:22.262341 18505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:22.262648 18505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:22.282341 18505 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:46433
I20260811 01:37:22.282377 18576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:46433 every 8 connection(s)
I20260811 01:37:22.283907 18505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:22.287858 18577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:22.291595 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18505
I20260811 01:37:22.291870 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:22.292533 17936 external_mini_cluster.cc:1428] Setting key e16602addc46081a6423c34573ea2d69
I20260811 01:37:22.299888 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7: Bootstrap starting.
I20260811 01:37:22.303876 18577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:22.305143 18577 log.cc:824] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:37:22 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:22.309101 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7: No bootstrap required, opened a new log
I20260811 01:37:22.317687 18577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } }
I20260811 01:37:22.318249 18577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:22.318367 18577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3caa10e70045e581007a639c4da7a7, State: Initialized, Role: FOLLOWER
I20260811 01:37:22.319031 18577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } }
I20260811 01:37:22.319319 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:22.294701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.17.132.62:46433)
0811 01:37:22.295555 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:22.295567 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:22.295610 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:37:22.298152 (+ 2542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:22.298180 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:22.298605 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:22.298960 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:22.300991 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.302475 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.304288 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.305024 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.305210 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:22.310414 (+ 5204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:22.310423 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:22.310441 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:22.310488 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:22.314428 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:22.315266 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:22.315279 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:22.315286 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:22.315474 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:22.315900 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:22.315906 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:22.315913 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:22.316530 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:22.316876 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:22.317412 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 01:37:22.317959 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":392,"threads_started":1}
I20260811 01:37:22.319319 18577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:22.319555 18577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:22.319783 18577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:22.322786 18577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } }
I20260811 01:37:22.323274 18577 leader_election.cc:302] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f3caa10e70045e581007a639c4da7a7; no voters:
I20260811 01:37:22.323843 18577 leader_election.cc:288] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:22.324044 18583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:22.324733 18583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3caa10e70045e581007a639c4da7a7, State: Running, Role: LEADER
I20260811 01:37:22.325369 18583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } }
I20260811 01:37:22.326275 18577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:22.328672 18585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f3caa10e70045e581007a639c4da7a7. Latest consensus state: current_term: 1 leader_uuid: "4f3caa10e70045e581007a639c4da7a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } } }
I20260811 01:37:22.329197 18585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:22.330811 18584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f3caa10e70045e581007a639c4da7a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f3caa10e70045e581007a639c4da7a7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46433 } } }
I20260811 01:37:22.331135 18584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:22.331801 18591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:22.336445 18591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:22.346289 18591 catalog_manager.cc:1347] Generated new cluster ID: ed7c9d99003346ffaa58d94901109914
I20260811 01:37:22.346434 18591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:22.357288 18591 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:22.358726 18591 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:22.369877 18591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f3caa10e70045e581007a639c4da7a7: Generated new TSK 0
I20260811 01:37:22.370786 18591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:22.427462 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:22.782775 18604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:22.783145 18604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:22.783336 18604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:22.790838 18604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:22.790954 18604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:22.791154 18604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:22.801574 18604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:22.803081 18604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:22.804543 18604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:22.818994 18609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:22.818974 18610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:22.819614 18612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:22.820763 18604 server_base.cc:1034] running on GCE node
I20260811 01:37:22.821434 18604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:22.822557 18604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:22.823769 18604 hybrid_clock.cc:648] HybridClock initialized: now 1786412242823699 us; error 56 us; skew 500 ppm
I20260811 01:37:22.824121 18604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:22 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:22.827718 18604 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:22.829432 18604 webserver.cc:460] Webserver started at http://127.17.132.1:45729/ using document root <none> and password file <none>
I20260811 01:37:22.830281 18604 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:22.830412 18604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:22.830749 18604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:22.833933 18604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "386aa20e2c7a4691a1f44fdc2bc0d420"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "67a6a5442fe8ce2b1f25b9f3487d3af4"
server_key_iv: "dda62f1411d5134d9bc7ac0764ac274d"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.834829 18604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "386aa20e2c7a4691a1f44fdc2bc0d420"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "67a6a5442fe8ce2b1f25b9f3487d3af4"
server_key_iv: "dda62f1411d5134d9bc7ac0764ac274d"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.840688 18604 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:37:22.844615 18620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:22.846349 18604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:22.846561 18604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "386aa20e2c7a4691a1f44fdc2bc0d420"
format_stamp: "Formatted at 2026-08-11 01:37:22 on dist-test-slave-0kls"
server_key: "67a6a5442fe8ce2b1f25b9f3487d3af4"
server_key_iv: "dda62f1411d5134d9bc7ac0764ac274d"
server_key_version: "encryptionkey@0"
I20260811 01:37:22.846782 18604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:22.870750 18604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:22.875968 18604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:22.876248 18604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:22.877317 18604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:22.878933 18604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:22.879020 18604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:22.879112 18604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:22.879158 18604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:22.913769 18604 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:36007
I20260811 01:37:22.913898 18741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:36007 every 8 connection(s)
I20260811 01:37:22.915215 18604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:22.920563 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18604
I20260811 01:37:22.920812 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:22.921459 17936 external_mini_cluster.cc:1428] Setting key 4d8c8f6e05c2e401350f93d9625710de
Aug 11 01:37:22 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412242, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:22.940589 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:22.918107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:49961 (local address 127.17.132.62:46433)
0811 01:37:22.918602 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:22.918607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:22.919650 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 01:37:22.921870 (+ 2220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:22.921877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:22.921985 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:22.922116 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:22.924395 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.925598 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.927547 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.928299 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.928449 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:22.932544 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:22.932554 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:22.932563 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:22.932629 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:22.936419 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:22.937394 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:22.937403 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:22.937409 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:22.937599 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:22.938197 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:22.938205 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:22.938211 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:22.938626 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:22.938794 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:22.939602 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 01:37:22.939921 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":233,"threads_started":1}
I20260811 01:37:22.941408 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:22.918752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46433 (local address 127.17.132.1:49961)
0811 01:37:22.919462 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:22.919507 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:22.921378 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:22.922457 (+ 1079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:22.922473 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:22.923280 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:22.924179 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:22.924211 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.925867 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.925877 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:22.927370 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:22.927384 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:22.928550 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:22.928555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:22.928775 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:22.929595 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:22.929621 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:22.932237 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:22.936634 (+ 4397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:22.936642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:22.936660 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:22.937202 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:22.937762 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:22.937766 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:22.937769 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:22.938057 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:22.938774 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:22.938780 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:22.939166 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 01:37:22.939432 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 01:37:22.939994 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":274,"threads_started":1}
I20260811 01:37:22.943279 18742 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46433
I20260811 01:37:22.943687 18742 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:22.944802 18742 heartbeater.cc:511] Master 127.17.132.62:46433 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:22.947440 18541 ts_manager.cc:194] Registered new tserver with Master: 386aa20e2c7a4691a1f44fdc2bc0d420 (127.17.132.1:36007)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:37:22.949177 18541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:49961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:22.974180 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:23.320974 18749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:23.321303 18749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:23.321480 18749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:23.329305 18749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:23.329432 18749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:23.329625 18749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:23.339993 18749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:23.341424 18749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:23.342875 18749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:23.356860 18756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:23.357029 18758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:23.357484 18755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:23.357731 18749 server_base.cc:1034] running on GCE node
I20260811 01:37:23.358410 18749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:23.359436 18749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:23.360788 18749 hybrid_clock.cc:648] HybridClock initialized: now 1786412243360718 us; error 55 us; skew 500 ppm
I20260811 01:37:23.361186 18749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:23 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412243, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:23.364531 18749 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:23.366220 18749 webserver.cc:460] Webserver started at http://127.17.132.2:44743/ using document root <none> and password file <none>
I20260811 01:37:23.366976 18749 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:23.367120 18749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:23.367460 18749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:23.370640 18749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "bb7678818fbc411d9c32ec962ff4d408"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "05a317930e00dafbefd08deede5a81f0"
server_key_iv: "5df71e5d70822a517cb480fa6bca9df6"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.371464 18749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "bb7678818fbc411d9c32ec962ff4d408"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "05a317930e00dafbefd08deede5a81f0"
server_key_iv: "5df71e5d70822a517cb480fa6bca9df6"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.376993 18749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:37:23.382325 18766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:23.383859 18749 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:37:23.384016 18749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "bb7678818fbc411d9c32ec962ff4d408"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "05a317930e00dafbefd08deede5a81f0"
server_key_iv: "5df71e5d70822a517cb480fa6bca9df6"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.384225 18749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:23.437218 18749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:23.442910 18749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:23.443202 18749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:23.444236 18749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:23.445766 18749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:23.445914 18749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 01:37:23.446022 18749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:23.446067 18749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:23.482347 18749 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:37671
I20260811 01:37:23.482439 18886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:37671 every 8 connection(s)
I20260811 01:37:23.483670 18749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:23.486084 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18749
I20260811 01:37:23.486305 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:23.486927 17936 external_mini_cluster.cc:1428] Setting key 2f893db9242af0d1c5faa7c4f470abda
Aug 11 01:37:23 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412243, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:37:23.509028 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:23.486526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:52595 (local address 127.17.132.62:46433)
0811 01:37:23.487037 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:23.487044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:23.488150 (+ 1106us) server_negotiation.cc:407] Connection header received
0811 01:37:23.490648 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:23.490652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:23.490717 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:23.490813 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:23.493158 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:23.494099 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:23.496517 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:23.497296 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:23.497454 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:23.501199 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:23.501208 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:23.501215 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:23.501264 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:23.505288 (+ 4024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:23.506272 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:23.506282 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:23.506288 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:23.506475 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:23.506949 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:23.506954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:23.506959 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:23.507354 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:23.507528 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:23.508304 (+ 776us) server_negotiation.cc:299] Negotiation successful
0811 01:37:23.508605 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":294,"threads_started":1}
I20260811 01:37:23.509986 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:23.487053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46433 (local address 127.17.132.2:52595)
0811 01:37:23.487969 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:23.488024 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:23.490337 (+ 2313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:23.491138 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:23.491154 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:23.492016 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:23.492935 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:23.492967 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:23.494278 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:23.494286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:23.496347 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:23.496361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:23.497564 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:23.497570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:23.497858 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:23.498586 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:23.498610 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:23.500930 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:23.505479 (+ 4549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:23.505488 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:23.505505 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:23.506128 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:23.506600 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:23.506603 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:23.506605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:23.506817 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:23.507489 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:23.507497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:23.507889 (+ 392us) client_negotiation.cc:769] Sending connection context
0811 01:37:23.508139 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 01:37:23.508609 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":316,"threads_started":1}
I20260811 01:37:23.511984 18887 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
I20260811 01:37:23.512372 18887 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:23.513520 18887 heartbeater.cc:511] Master 127.17.132.62:46433 requested a full tablet report, sending...
I20260811 01:37:23.515547 18541 ts_manager.cc:194] Registered new tserver with Master: bb7678818fbc411d9c32ec962ff4d408 (127.17.132.2:37671)
I20260811 01:37:23.516528 18541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:52595
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:23.539645 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:45513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:23.891494 18893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:23.891867 18893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:23.892043 18893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:23.899732 18893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:23.899924 18893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:23.900115 18893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:23.910385 18893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:45513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46433
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:23.911847 18893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:23.913349 18893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:23.927646 18898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:23.927750 18899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:23.927748 18901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:23.928192 18893 server_base.cc:1034] running on GCE node
I20260811 01:37:23.929144 18893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:23.930306 18893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:23.931559 18893 hybrid_clock.cc:648] HybridClock initialized: now 1786412243931516 us; error 56 us; skew 500 ppm
I20260811 01:37:23.931911 18893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:23 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412243, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:23.935326 18893 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:23.936985 18893 webserver.cc:460] Webserver started at http://127.17.132.3:39429/ using document root <none> and password file <none>
I20260811 01:37:23.937775 18893 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:23.937948 18893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:23.938244 18893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:23.941409 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "b8f4749861c24e9fa3318d709cfe6370"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "5f8192e7b91d12bf7bc6e58fcd6006c8"
server_key_iv: "eb582ea4d73761956d594289686fedfc"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.942301 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "b8f4749861c24e9fa3318d709cfe6370"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "5f8192e7b91d12bf7bc6e58fcd6006c8"
server_key_iv: "eb582ea4d73761956d594289686fedfc"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.947922 18893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:37:23.952121 18908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:23.953346 18742 heartbeater.cc:503] Master 127.17.132.62:46433 was elected leader, sending a full tablet report...
I20260811 01:37:23.953894 18893 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:37:23.954118 18893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "b8f4749861c24e9fa3318d709cfe6370"
format_stamp: "Formatted at 2026-08-11 01:37:23 on dist-test-slave-0kls"
server_key: "5f8192e7b91d12bf7bc6e58fcd6006c8"
server_key_iv: "eb582ea4d73761956d594289686fedfc"
server_key_version: "encryptionkey@0"
I20260811 01:37:23.954350 18893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:23.980897 18893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:23.985046 18893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:23.985356 18893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:23.986449 18893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:23.987900 18893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:23.988000 18893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:23.988147 18893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:23.988225 18893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:24.030553 18893 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:39801
I20260811 01:37:24.030719 19031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:39801 every 8 connection(s)
I20260811 01:37:24.031970 18893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:24.033208 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 18893
I20260811 01:37:24.033433 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:24.034030 17936 external_mini_cluster.cc:1428] Setting key 75abb8cd9337389551eccfa5e74a2ce2
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412243, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:24.054116 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.035436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:59637 (local address 127.17.132.62:46433)
0811 01:37:24.035955 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.035963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.036944 (+ 981us) server_negotiation.cc:407] Connection header received
0811 01:37:24.039149 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.039153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.039220 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.039316 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.040991 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.041773 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.043455 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.043854 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.043951 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.047775 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.047780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.047783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.047837 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.050842 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.051711 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.051730 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.051734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.051855 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.052301 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.052308 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.052312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.052591 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.052761 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.053462 (+ 701us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.053685 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":248,"threads_started":1}
I20260811 01:37:24.055112 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.035823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46433 (local address 127.17.132.3:59637)
0811 01:37:24.036760 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.036817 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.038881 (+ 2064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.039531 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.039541 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.040140 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:24.040832 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.040853 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.041992 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.041996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.043315 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.043328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.044103 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.044109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.044325 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.045145 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:24.045171 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:24.047528 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:24.050985 (+ 3457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:24.050995 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:24.051014 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:24.051599 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:24.051964 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:24.051970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:24.051973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:24.052183 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:24.052730 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:24.052738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:24.053102 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.053383 (+ 281us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.053969 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":331,"threads_started":1}
I20260811 01:37:24.056596 19032 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46433
I20260811 01:37:24.056926 19032 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:24.057754 19032 heartbeater.cc:511] Master 127.17.132.62:46433 requested a full tablet report, sending...
I20260811 01:37:24.059369 18541 ts_manager.cc:194] Registered new tserver with Master: b8f4749861c24e9fa3318d709cfe6370 (127.17.132.3:39801)
I20260811 01:37:24.060151 18541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:59637
I20260811 01:37:24.062548 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:37:24.082146 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.069052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48574 (local address 127.17.132.62:46433)
0811 01:37:24.069322 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.069331 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.069908 (+ 577us) server_negotiation.cc:407] Connection header received
0811 01:37:24.070091 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.070095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.070161 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.070260 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.071770 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.072520 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.073883 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.074286 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.074379 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.076920 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.076925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.076929 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.076963 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.079633 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.080357 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.080361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.080363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.080486 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.080798 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.080801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.080803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.081105 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.081292 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.081624 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.081855 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:37:24.089128 18541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:24.096204 18541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:24.131640 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.108942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:37671 (local address 127.0.0.1:40922)
0811 01:37:24.121456 (+ 12514us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.121507 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.121735 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.123691 (+ 1956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.123697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.123745 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.124377 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.124400 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.126160 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.126168 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.128358 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.128371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.130491 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.130497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.130712 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.130796 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.130953 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.131136 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12179,"spinlock_wait_cycles":1408,"thread_start_us":13235,"threads_started":1}
I20260811 01:37:24.132115 19048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.109669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53892 (local address 127.17.132.3:39801)
0811 01:37:24.122597 (+ 12928us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.122608 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.122648 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:37:24.122751 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.122759 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.123025 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.123239 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.125185 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.127101 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.129496 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.130629 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.130766 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.130994 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.131277 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.131452 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12725,"thread_start_us":12431,"threads_started":1}
I20260811 01:37:24.132573 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.109021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.17.132.2:37671)
0811 01:37:24.122866 (+ 13845us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.122874 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.122899 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:37:24.122991 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.122998 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.123204 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.123444 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.124632 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.126029 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.128522 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.130263 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.130414 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.130630 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.131907 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.132092 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13661,"thread_start_us":13827,"threads_started":1}
I20260811 01:37:24.131822 19047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.109245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:39801 (local address 127.0.0.1:53892)
0811 01:37:24.122384 (+ 13139us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.122403 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.122522 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.123595 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.123602 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.123632 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.124901 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.124919 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.127276 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.127282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.129325 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.129338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.130883 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.130889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.131090 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.131119 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.131209 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.131359 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12945,"mutex_wait_us":28,"spinlock_wait_cycles":4352,"thread_start_us":13369,"threads_started":1}
I20260811 01:37:24.134142 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.123363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:36007 (local address 127.0.0.1:48840)
0811 01:37:24.124739 (+ 1376us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.124753 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.124901 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.125862 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.125867 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.125895 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.126567 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.126584 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.128581 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.128588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.130909 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.130921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.133268 (+ 2347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.133276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.133450 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.133482 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.133578 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.133717 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":4,"thread_start_us":1091,"threads_started":1}
I20260811 01:37:24.136420 18960 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e (DEFAULT_TABLE table=test-table [id=f7fedc710b474906b4c203bce63653dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:24.136466 18816 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e (DEFAULT_TABLE table=test-table [id=f7fedc710b474906b4c203bce63653dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:24.137072 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.123572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48840 (local address 127.17.132.1:36007)
0811 01:37:24.124347 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.124356 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.124865 (+ 509us) server_negotiation.cc:407] Connection header received
0811 01:37:24.125078 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.125089 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.125314 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.125599 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.126801 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.128430 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.131105 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.132487 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.132627 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.132883 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.133645 (+ 762us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.133846 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":414,"threads_started":1}
I20260811 01:37:24.137972 18960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:24.138043 18816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:24.141068 18673 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e (DEFAULT_TABLE table=test-table [id=f7fedc710b474906b4c203bce63653dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:24.142750 18673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:24.151198 19051 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Bootstrap starting.
I20260811 01:37:24.153559 19052 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Bootstrap starting.
I20260811 01:37:24.156565 19051 tablet_bootstrap.cc:654] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:24.157460 19052 tablet_bootstrap.cc:654] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:24.157526 19053 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Bootstrap starting.
I20260811 01:37:24.158018 19051 log.cc:824] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:24.158892 19052 log.cc:824] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:24.161619 19051 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: No bootstrap required, opened a new log
I20260811 01:37:24.161921 19053 tablet_bootstrap.cc:654] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:24.162009 19051 ts_tablet_manager.cc:1397] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:37:24.162462 19052 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: No bootstrap required, opened a new log
I20260811 01:37:24.162729 19052 ts_tablet_manager.cc:1397] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 01:37:24.163292 19053 log.cc:824] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:24.166805 19053 tablet_bootstrap.cc:492] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: No bootstrap required, opened a new log
I20260811 01:37:24.167089 19053 ts_tablet_manager.cc:1397] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 01:37:24.171047 19052 raft_consensus.cc:348] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.171476 19052 raft_consensus.cc:374] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:24.171597 19052 raft_consensus.cc:729] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f4749861c24e9fa3318d709cfe6370, State: Initialized, Role: FOLLOWER
I20260811 01:37:24.172250 19052 consensus_queue.cc:260] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.173311 19051 raft_consensus.cc:348] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.173810 19051 raft_consensus.cc:374] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:24.173907 19051 raft_consensus.cc:729] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7678818fbc411d9c32ec962ff4d408, State: Initialized, Role: FOLLOWER
I20260811 01:37:24.174353 19052 ts_tablet_manager.cc:1428] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260811 01:37:24.174569 19051 consensus_queue.cc:260] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.174868 19032 heartbeater.cc:503] Master 127.17.132.62:46433 was elected leader, sending a full tablet report...
I20260811 01:37:24.176069 18887 heartbeater.cc:503] Master 127.17.132.62:46433 was elected leader, sending a full tablet report...
I20260811 01:37:24.176729 19051 ts_tablet_manager.cc:1428] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260811 01:37:24.178453 19053 raft_consensus.cc:348] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.179001 19053 raft_consensus.cc:374] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:24.179127 19053 raft_consensus.cc:729] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386aa20e2c7a4691a1f44fdc2bc0d420, State: Initialized, Role: FOLLOWER
I20260811 01:37:24.179801 19053 consensus_queue.cc:260] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.181877 19053 ts_tablet_manager.cc:1428] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
W20260811 01:37:24.235885 18888 tablet.cc:2369] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:37:24.283836 19033 tablet.cc:2369] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:24.331928 19061 raft_consensus.cc:482] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:24.332307 19061 raft_consensus.cc:504] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.334264 19061 leader_election.cc:288] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb7678818fbc411d9c32ec962ff4d408 (127.17.132.2:37671), b8f4749861c24e9fa3318d709cfe6370 (127.17.132.3:39801)
I20260811 01:37:24.343115 19058 raft_consensus.cc:482] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:24.343487 19058 raft_consensus.cc:504] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.344064 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.334782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:47799 (local address 127.17.132.2:37671)
0811 01:37:24.335041 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.335049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.335953 (+ 904us) server_negotiation.cc:407] Connection header received
0811 01:37:24.336169 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.336175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.336250 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.336324 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.336975 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.338079 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.341149 (+ 3070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.342561 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.342701 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.342767 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.343630 (+ 863us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.343801 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:37:24.344137 19062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.334643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:39801 (local address 127.17.132.1:59361)
0811 01:37:24.335436 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.335460 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.335657 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.336043 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.336051 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.336140 (+ 89us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.336564 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.336583 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.338095 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.338099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.340948 (+ 2849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.340965 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.343042 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.343050 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.343373 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.343455 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.343564 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.343709 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":208,"thread_start_us":444,"threads_started":1}
I20260811 01:37:24.344606 19048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.334872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:59361 (local address 127.17.132.3:39801)
0811 01:37:24.335130 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.335139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.335580 (+ 441us) server_negotiation.cc:407] Connection header received
0811 01:37:24.335816 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.335821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.335885 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.336003 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.336739 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.337967 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.341142 (+ 3175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.342448 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.342666 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.342745 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.343625 (+ 880us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.343790 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:37:24.344688 19063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.334668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:37671 (local address 127.17.132.1:47799)
0811 01:37:24.335689 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.335703 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.335993 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.336372 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.336376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.336405 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.336817 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.336826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.338210 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.338220 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.340948 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.340965 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.343119 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.343127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.343387 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.343458 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.344267 (+ 809us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.344395 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":887,"mutex_wait_us":216,"thread_start_us":690,"threads_started":1}
I20260811 01:37:24.345552 18982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f4749861c24e9fa3318d709cfe6370" is_pre_election: true
I20260811 01:37:24.345875 19058 leader_election.cc:288] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386aa20e2c7a4691a1f44fdc2bc0d420 (127.17.132.1:36007), b8f4749861c24e9fa3318d709cfe6370 (127.17.132.3:39801)
I20260811 01:37:24.346242 18982 raft_consensus.cc:2454] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386aa20e2c7a4691a1f44fdc2bc0d420 in term 0.
I20260811 01:37:24.346042 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7678818fbc411d9c32ec962ff4d408" is_pre_election: true
I20260811 01:37:24.347084 18838 raft_consensus.cc:2454] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386aa20e2c7a4691a1f44fdc2bc0d420 in term 0.
I20260811 01:37:24.347146 18624 leader_election.cc:302] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386aa20e2c7a4691a1f44fdc2bc0d420, b8f4749861c24e9fa3318d709cfe6370; no voters:
I20260811 01:37:24.347694 19061 raft_consensus.cc:2781] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:24.347877 19061 raft_consensus.cc:482] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:24.348001 19061 raft_consensus.cc:3037] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:24.351368 19061 raft_consensus.cc:504] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.352097 19061 leader_election.cc:288] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [CANDIDATE]: Term 1 election: Requested vote from peers bb7678818fbc411d9c32ec962ff4d408 (127.17.132.2:37671), b8f4749861c24e9fa3318d709cfe6370 (127.17.132.3:39801)
I20260811 01:37:24.352743 18982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f4749861c24e9fa3318d709cfe6370"
I20260811 01:37:24.352990 18982 raft_consensus.cc:3037] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:24.353271 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7678818fbc411d9c32ec962ff4d408"
I20260811 01:37:24.353483 18838 raft_consensus.cc:3037] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:24.356413 18982 raft_consensus.cc:2454] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386aa20e2c7a4691a1f44fdc2bc0d420 in term 1.
I20260811 01:37:24.357043 18838 raft_consensus.cc:2454] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386aa20e2c7a4691a1f44fdc2bc0d420 in term 1.
I20260811 01:37:24.357033 18624 leader_election.cc:302] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386aa20e2c7a4691a1f44fdc2bc0d420, b8f4749861c24e9fa3318d709cfe6370; no voters:
I20260811 01:37:24.357103 19065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.346320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:39801 (local address 127.17.132.2:35787)
0811 01:37:24.348694 (+ 2374us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.348711 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.348873 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.349440 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.349445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.349467 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.349981 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.349995 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.351516 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.351527 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.353697 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.353715 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.355689 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.355697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.355896 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.355933 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.356450 (+ 517us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.356608 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2266,"thread_start_us":1794,"threads_started":1}
I20260811 01:37:24.357568 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.346615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:54279 (local address 127.17.132.1:36007)
0811 01:37:24.346848 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.346855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.348283 (+ 1428us) server_negotiation.cc:407] Connection header received
0811 01:37:24.348630 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.348636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.348723 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.348795 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.349655 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.350944 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.354900 (+ 3956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.356243 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.356377 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.356449 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.357144 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.357295 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:37:24.357722 19048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.346704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:35787 (local address 127.17.132.3:39801)
0811 01:37:24.346920 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.346927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.348783 (+ 1856us) server_negotiation.cc:407] Connection header received
0811 01:37:24.349022 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.349027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.349170 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.349237 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:24.350181 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.351290 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.353901 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.355266 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.355439 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.355515 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.356101 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.356269 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 01:37:24.358150 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.346192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:36007 (local address 127.17.132.2:54279)
0811 01:37:24.348182 (+ 1990us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:24.348203 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:24.348415 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:24.349010 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:24.349014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:24.349044 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:24.349452 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.349463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.351129 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.351134 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.354690 (+ 3556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:24.354706 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.356652 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.356658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:24.356899 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.356943 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:37:24.357595 (+ 652us) client_negotiation.cc:240] Negotiation successful
0811 01:37:24.357754 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1849,"thread_start_us":3209,"threads_started":1}
I20260811 01:37:24.358359 19061 raft_consensus.cc:2781] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:24.358538 18980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "bb7678818fbc411d9c32ec962ff4d408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f4749861c24e9fa3318d709cfe6370" is_pre_election: true
I20260811 01:37:24.359040 18980 raft_consensus.cc:2379] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P b8f4749861c24e9fa3318d709cfe6370 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb7678818fbc411d9c32ec962ff4d408 in current term 1: Already voted for candidate 386aa20e2c7a4691a1f44fdc2bc0d420 in this term.
I20260811 01:37:24.359441 18694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc9fe3d6f4a4daea6399cdfc8c63d9e" candidate_uuid: "bb7678818fbc411d9c32ec962ff4d408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" is_pre_election: true
I20260811 01:37:24.359913 19061 raft_consensus.cc:686] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [term 1 LEADER]: Becoming Leader. State: Replica: 386aa20e2c7a4691a1f44fdc2bc0d420, State: Running, Role: LEADER
I20260811 01:37:24.360419 19061 consensus_queue.cc:237] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } }
I20260811 01:37:24.365105 18768 leader_election.cc:302] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb7678818fbc411d9c32ec962ff4d408; no voters: 386aa20e2c7a4691a1f44fdc2bc0d420, b8f4749861c24e9fa3318d709cfe6370
I20260811 01:37:24.365602 19058 raft_consensus.cc:2726] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P bb7678818fbc411d9c32ec962ff4d408 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 01:37:24.366384 18541 catalog_manager.cc:5495] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386aa20e2c7a4691a1f44fdc2bc0d420 (127.17.132.1). New cstate: current_term: 1 leader_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb7678818fbc411d9c32ec962ff4d408" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386aa20e2c7a4691a1f44fdc2bc0d420" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 36007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8f4749861c24e9fa3318d709cfe6370" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 39801 } health_report { overall_health: UNKNOWN } } }
W20260811 01:37:24.418134 18743 tablet.cc:2369] T 3dc9fe3d6f4a4daea6399cdfc8c63d9e P 386aa20e2c7a4691a1f44fdc2bc0d420: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:24.426663 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.409290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.17.132.1:36007)
0811 01:37:24.409548 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.409557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.410275 (+ 718us) server_negotiation.cc:407] Connection header received
0811 01:37:24.410457 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.410462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.410537 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.410639 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.412297 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.413101 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.414751 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.415242 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.415364 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.420126 (+ 4762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.420144 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.420161 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.420207 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.423429 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.424294 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.424304 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.424306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.424452 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.424821 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.424825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.424827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.425264 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.425507 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.425907 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.426375 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:24.487092 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.472028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48854 (local address 127.17.132.1:36007)
0811 01:37:24.472267 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.472276 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.472691 (+ 415us) server_negotiation.cc:407] Connection header received
0811 01:37:24.472912 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.472916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.472986 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.473100 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.474621 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.475359 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.476629 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.477064 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.477202 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.481307 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.481312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.481316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.481354 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.484154 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.484842 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.484848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.484852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.484991 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.485404 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.485409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.485412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.485867 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.486230 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.486476 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.486741 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:24.544536 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.528789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48866 (local address 127.17.132.1:36007)
0811 01:37:24.529021 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.529029 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.529533 (+ 504us) server_negotiation.cc:407] Connection header received
0811 01:37:24.529761 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.529766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.529893 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.530003 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.531492 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.532234 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.533534 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.534079 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.534220 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.538668 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.538674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.538678 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.538720 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.541690 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.542489 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.542494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.542496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.542704 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.543083 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.543086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.543089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.543450 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.543681 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.543966 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.544261 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 01:37:24.547070 18652 tablet_service.cc:2908] Rejecting scan request for tablet 3dc9fe3d6f4a4daea6399cdfc8c63d9e: Uninitialized: clean time has not yet been initialized
I20260811 01:37:24.551309 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18604
I20260811 01:37:24.565896 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.552336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48872 (local address 127.17.132.1:36007)
0811 01:37:24.552548 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.552553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.552919 (+ 366us) server_negotiation.cc:407] Connection header received
0811 01:37:24.553054 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.553058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.553155 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.553313 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.554847 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.555613 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.556984 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.557448 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.557644 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.560298 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.560303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.560307 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.560344 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.563045 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.563750 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.563756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.563760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.563906 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.564297 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.564303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.564311 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.564599 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.564933 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.565204 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.565457 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:37:24.566669 18737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:24.662161 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18604
I20260811 01:37:24.684859 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18749
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:24.701061 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.685694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.17.132.2:37671)
0811 01:37:24.685928 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.685933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.685952 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:37:24.686199 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.686204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.686273 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.686367 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.687655 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.688441 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.690035 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.690441 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.690543 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.694715 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.694731 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.694756 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.694801 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.697636 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.698701 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.698709 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.698711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.698877 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.699443 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.699446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.699448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.699869 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.700100 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.700421 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.700602 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:37:24.702025 18882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:24.795169 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18749
I20260811 01:37:24.817575 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18893
Aug 11 01:37:24 dist-test-slave-0kls krb5kdc[18491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:24.833889 19048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:24.818772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.17.132.3:39801)
0811 01:37:24.819016 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:24.819023 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:24.819067 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:37:24.819298 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:24.819302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:24.819371 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:24.819480 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:24.820813 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.821505 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.822923 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:24.823352 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:24.823485 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:24.827903 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:24.827921 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:24.827940 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:24.827988 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:24.830885 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.831656 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.831666 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.831668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.831830 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:24.832235 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:24.832242 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:24.832246 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:24.832622 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:24.832954 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:24.833257 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 01:37:24.833493 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 01:37:24.834554 19026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:24.927868 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18893
I20260811 01:37:24.948693 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 18505
I20260811 01:37:24.950147 18572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:25.065531 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 18505
2026-08-11T01:37:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4596 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:25 dist-test-slave-0kls krb5kdc[19085](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:25 dist-test-slave-0kls krb5kdc[19085](info): set up 2 sockets
Aug 11 01:37:25 dist-test-slave-0kls krb5kdc[19085](info): commencing operation
krb5kdc: starting...
W20260811 01:37:26.242868 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:26 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:26.470284 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40205
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:26.829535 19099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:26.829862 19099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:26.829957 19099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:26.837378 19099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:26.837507 19099 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:37:26.837548 19099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:26.837603 19099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:26.837661 19099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:26.837725 19099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:26.848213 19099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40205
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:26.849552 19099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:26.850919 19099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:26.863698 19104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:26.863600 19108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:26.863726 19105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:26.864811 19099 server_base.cc:1034] running on GCE node
I20260811 01:37:26.865669 19099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:26.867267 19099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:26.868559 19099 hybrid_clock.cc:648] HybridClock initialized: now 1786412246868448 us; error 52 us; skew 500 ppm
I20260811 01:37:26.868954 19099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:26 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412246, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:26.872386 19099 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:26.874195 19099 webserver.cc:460] Webserver started at http://127.17.132.62:37473/ using document root <none> and password file <none>
I20260811 01:37:26.874970 19099 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:26.875113 19099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:26.875478 19099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:26.878799 19099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "2a53c57e179b49a8974ad65e846f7357"
format_stamp: "Formatted at 2026-08-11 01:37:26 on dist-test-slave-0kls"
server_key: "204e19ac0e81af5b7bdb3cee7484ea1e"
server_key_iv: "195328ed960d067d4a6491ad1767a6f0"
server_key_version: "encryptionkey@0"
I20260811 01:37:26.879627 19099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "2a53c57e179b49a8974ad65e846f7357"
format_stamp: "Formatted at 2026-08-11 01:37:26 on dist-test-slave-0kls"
server_key: "204e19ac0e81af5b7bdb3cee7484ea1e"
server_key_iv: "195328ed960d067d4a6491ad1767a6f0"
server_key_version: "encryptionkey@0"
I20260811 01:37:26.885346 19099 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:37:26.889107 19115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:26.890698 19099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:37:26.890889 19099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "2a53c57e179b49a8974ad65e846f7357"
format_stamp: "Formatted at 2026-08-11 01:37:26 on dist-test-slave-0kls"
server_key: "204e19ac0e81af5b7bdb3cee7484ea1e"
server_key_iv: "195328ed960d067d4a6491ad1767a6f0"
server_key_version: "encryptionkey@0"
I20260811 01:37:26.891139 19099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:26.912312 19099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:26.917229 19099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:26.917688 19099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:26.941905 19099 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:40205
I20260811 01:37:26.941885 19182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:40205 every 8 connection(s)
I20260811 01:37:26.943365 19099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:26.944662 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19099
I20260811 01:37:26.944926 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:26.945598 17936 external_mini_cluster.cc:1428] Setting key 0a64338624ab857151f116c45eaec034
I20260811 01:37:26.948028 19183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:37:26 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:26.962227 19183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Bootstrap starting.
I20260811 01:37:26.966667 19183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:26.967984 19183 log.cc:824] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:26.971274 19186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:26.947682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51256 (local address 127.17.132.62:40205)
0811 01:37:26.948505 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:26.948518 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:26.948569 (+ 51us) server_negotiation.cc:407] Connection header received
0811 01:37:26.950369 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:26.950392 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:26.950792 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:26.951144 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:26.953014 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:26.954543 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:26.956291 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:26.956960 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:26.957092 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:26.962177 (+ 5085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:26.962188 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:26.962216 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:26.962274 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:26.966255 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:26.967170 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:26.967179 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:26.967188 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:26.967395 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:26.967837 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:26.967843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:26.967846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:26.968624 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:26.968916 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:26.969448 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 01:37:26.969921 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":414,"threads_started":1}
I20260811 01:37:26.971815 19183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: No bootstrap required, opened a new log
I20260811 01:37:26.979998 19183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } }
I20260811 01:37:26.980495 19183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:26.980657 19183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a53c57e179b49a8974ad65e846f7357, State: Initialized, Role: FOLLOWER
I20260811 01:37:26.981248 19183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } }
I20260811 01:37:26.981508 19183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:26.981674 19183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:26.981890 19183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:26.984108 19183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } }
I20260811 01:37:26.984665 19183 leader_election.cc:302] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a53c57e179b49a8974ad65e846f7357; no voters:
I20260811 01:37:26.985361 19183 leader_election.cc:288] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:26.985522 19188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:26.986327 19188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [term 1 LEADER]: Becoming Leader. State: Replica: 2a53c57e179b49a8974ad65e846f7357, State: Running, Role: LEADER
I20260811 01:37:26.987013 19188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } }
I20260811 01:37:26.987814 19183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:26.990278 19190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a53c57e179b49a8974ad65e846f7357. Latest consensus state: current_term: 1 leader_uuid: "2a53c57e179b49a8974ad65e846f7357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } } }
I20260811 01:37:26.990288 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a53c57e179b49a8974ad65e846f7357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a53c57e179b49a8974ad65e846f7357" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40205 } } }
I20260811 01:37:26.990724 19190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:26.990860 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:26.992453 19194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:26.998356 19194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:27.016594 19194 catalog_manager.cc:1347] Generated new cluster ID: 05e30e34ef534e8b940038ae56b260ce
I20260811 01:37:27.016736 19194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:27.036576 19194 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:27.038990 19194 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:27.047842 19194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Generated new TSK 0
I20260811 01:37:27.048997 19194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:27.105773 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40205
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:27.474188 19209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:27.474511 19209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:27.474687 19209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:27.482985 19209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:27.483180 19209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:27.483507 19209 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:27.483665 19209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:27.494733 19209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:27.496327 19209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:27.497991 19209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:27.512367 19214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:27.512435 19215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:27.512406 19217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:27.513113 19209 server_base.cc:1034] running on GCE node
I20260811 01:37:27.513938 19209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:27.515100 19209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:27.516356 19209 hybrid_clock.cc:648] HybridClock initialized: now 1786412247516267 us; error 61 us; skew 500 ppm
I20260811 01:37:27.516695 19209 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:27 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412247, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:27.529731 19209 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:27.531539 19209 webserver.cc:460] Webserver started at http://127.17.132.1:46391/ using document root <none> and password file <none>
I20260811 01:37:27.532347 19209 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:27.532492 19209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:27.532861 19209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:27.536113 19209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "b0f50bc45a89458982d34592d247a9e2"
format_stamp: "Formatted at 2026-08-11 01:37:27 on dist-test-slave-0kls"
server_key: "77b6915fd0807d0d82ede5e4e41b6702"
server_key_iv: "b4f4ade86a3dd60f27d35bb2de89eb42"
server_key_version: "encryptionkey@0"
I20260811 01:37:27.537006 19209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "b0f50bc45a89458982d34592d247a9e2"
format_stamp: "Formatted at 2026-08-11 01:37:27 on dist-test-slave-0kls"
server_key: "77b6915fd0807d0d82ede5e4e41b6702"
server_key_iv: "b4f4ade86a3dd60f27d35bb2de89eb42"
server_key_version: "encryptionkey@0"
I20260811 01:37:27.542938 19209 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:37:27.546938 19224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:27.548481 19209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260811 01:37:27.548687 19209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "b0f50bc45a89458982d34592d247a9e2"
format_stamp: "Formatted at 2026-08-11 01:37:27 on dist-test-slave-0kls"
server_key: "77b6915fd0807d0d82ede5e4e41b6702"
server_key_iv: "b4f4ade86a3dd60f27d35bb2de89eb42"
server_key_version: "encryptionkey@0"
I20260811 01:37:27.548933 19209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:27.572392 19209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:27.577342 19209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:27.577673 19209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:27.581002 19209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:27.581135 19209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:27.581317 19209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:27.581434 19209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:27 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412247, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:27.607993 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:27.581741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:42567 (local address 127.17.132.62:40205)
0811 01:37:27.582615 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:27.582620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:27.584494 (+ 1874us) server_negotiation.cc:407] Connection header received
0811 01:37:27.587165 (+ 2671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:27.587173 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:27.587283 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:27.587429 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:27.589974 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.591143 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.594534 (+ 3391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.594979 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.595137 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:27.601060 (+ 5923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:27.601067 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:27.601070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:27.601109 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:27.604197 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:27.605100 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:27.605106 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:27.605108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:27.605241 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:27.605752 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:27.605756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:27.605758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:27.606232 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:27.606393 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:27.607361 (+ 968us) server_negotiation.cc:299] Negotiation successful
0811 01:37:27.607614 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":567,"threads_started":1}
I20260811 01:37:27.609159 19234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:27.582545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.1:42567)
0811 01:37:27.584233 (+ 1688us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:27.584301 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:27.586739 (+ 2438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:27.587673 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:27.587683 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:27.588637 (+ 954us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:27.589726 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:27.589756 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.591387 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.591398 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:27.594244 (+ 2846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:27.594270 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.595338 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.595350 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:27.595722 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:27.596859 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:27.596913 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:27.600630 (+ 3717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:27.604395 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:27.604406 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:27.604428 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:27.604931 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:27.605366 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:27.605372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:27.605375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:27.605605 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:27.606479 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:27.606488 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:27.606925 (+ 437us) client_negotiation.cc:769] Sending connection context
0811 01:37:27.607230 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 01:37:27.607843 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"thread_start_us":1010,"threads_started":1}
I20260811 01:37:27.635133 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:27.616877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.1:34451)
0811 01:37:27.617556 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:27.617572 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:27.617774 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:27.618466 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:27.618469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:27.619268 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:27.619794 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:27.619810 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.621268 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.621274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:27.623227 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:27.623244 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.624216 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.624228 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:27.624529 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:27.625378 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:27.625412 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:27.627095 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:27.631199 (+ 4104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:27.631203 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:27.631206 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:27.631724 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:27.632296 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:27.632308 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:27.632315 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:27.632512 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:27.633455 (+ 943us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:27.633463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:27.633851 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 01:37:27.634121 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 01:37:27.634777 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":391,"threads_started":1}
I20260811 01:37:27.635663 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:27.616768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:34451 (local address 127.17.132.62:40205)
0811 01:37:27.616966 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:27.616974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:27.617692 (+ 718us) server_negotiation.cc:407] Connection header received
0811 01:37:27.617990 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:27.617995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:27.618148 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:27.618269 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:27.620039 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.621121 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.623388 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:27.623998 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:27.624134 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:27.627359 (+ 3225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:27.627367 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:27.627375 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:27.627421 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:27.631038 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:27.631904 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:27.631909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:27.631913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:27.632116 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:27.632687 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:27.632696 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:27.632702 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:27.633188 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:27.633374 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:27.634787 (+ 1413us) server_negotiation.cc:299] Negotiation successful
0811 01:37:27.635123 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:37:27.643712 19209 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:33145
I20260811 01:37:27.643749 19352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:33145 every 8 connection(s)
I20260811 01:37:27.645030 19209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:27.647426 19354 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40205
I20260811 01:37:27.647682 19354 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:27.647882 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19209
I20260811 01:37:27.648144 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:27.648488 19354 heartbeater.cc:511] Master 127.17.132.62:40205 requested a full tablet report, sending...
I20260811 01:37:27.648856 17936 external_mini_cluster.cc:1428] Setting key 5d9cbb75faaa5727a8c7cfcece314d28
I20260811 01:37:27.651027 19134 ts_manager.cc:194] Registered new tserver with Master: b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145)
I20260811 01:37:27.652665 19134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:42567
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:27.697043 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40205
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:28.064061 19358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:28.064380 19358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:28.064482 19358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:28.072120 19358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:28.072254 19358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:28.072341 19358 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:28.072423 19358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:28.082705 19358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:28.084062 19358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:28.085393 19358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:28.099740 19366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:28.099695 19363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:28.099789 19364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:28.100543 19358 server_base.cc:1034] running on GCE node
I20260811 01:37:28.101212 19358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:28.102274 19358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:28.103521 19358 hybrid_clock.cc:648] HybridClock initialized: now 1786412248103442 us; error 56 us; skew 500 ppm
I20260811 01:37:28.103839 19358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:28.107304 19358 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:28.109227 19358 webserver.cc:460] Webserver started at http://127.17.132.2:35761/ using document root <none> and password file <none>
I20260811 01:37:28.110114 19358 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:28.110276 19358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:28.110636 19358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:28.114202 19358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "10d4876df659452187ccc4abe16a6610"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "bdf3389e2dcb05c71dc447bcda5723d0"
server_key_iv: "f05765a73a3f05a82a56ac10ea41a0a4"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.115108 19358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "10d4876df659452187ccc4abe16a6610"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "bdf3389e2dcb05c71dc447bcda5723d0"
server_key_iv: "f05765a73a3f05a82a56ac10ea41a0a4"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.120915 19358 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 01:37:28.125335 19373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:28.127084 19358 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:37:28.127308 19358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "10d4876df659452187ccc4abe16a6610"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "bdf3389e2dcb05c71dc447bcda5723d0"
server_key_iv: "f05765a73a3f05a82a56ac10ea41a0a4"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.127599 19358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:28.151445 19358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:28.156612 19358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:28.156931 19358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:28.160069 19358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:28.160205 19358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:28.160375 19358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:28.160475 19358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:28.188939 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.160829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:52673 (local address 127.17.132.62:40205)
0811 01:37:28.161498 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.161503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.162958 (+ 1455us) server_negotiation.cc:407] Connection header received
0811 01:37:28.165352 (+ 2394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.165358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.165455 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.165588 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:28.168725 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.169928 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.173393 (+ 3465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.174032 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.174201 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.180141 (+ 5940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:28.180149 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:28.180155 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:28.180207 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:28.183694 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.185041 (+ 1347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.185047 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.185051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.185230 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.186010 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.186015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.186019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.186471 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:28.186638 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.187903 (+ 1265us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.188268 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":435,"threads_started":1}
I20260811 01:37:28.189692 19383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.161526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.2:52673)
0811 01:37:28.162758 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.162799 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.165011 (+ 2212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.166103 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.166117 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.167219 (+ 1102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:28.168427 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.168470 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.170138 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.170148 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.173115 (+ 2967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.173137 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.174319 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.174326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.174682 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.175616 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:28.175663 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:28.179796 (+ 4133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:28.183903 (+ 4107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.183918 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.183945 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.184845 (+ 900us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.185396 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.185403 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.185405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.185864 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.186717 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:28.186724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:28.187326 (+ 602us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.187781 (+ 455us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.188284 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":969,"thread_start_us":421,"threads_started":1}
I20260811 01:37:28.210906 19382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.196310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:57863 (local address 127.17.132.62:40205)
0811 01:37:28.196474 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.196478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.197191 (+ 713us) server_negotiation.cc:407] Connection header received
0811 01:37:28.197416 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.197420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.197486 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.197591 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:28.199008 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.199746 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.201235 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.201643 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.201838 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.204289 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:28.204294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:28.204298 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:28.204330 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:28.207682 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.208741 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.208745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.208747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.208858 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.209240 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.209245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.209250 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.209579 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:28.209762 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.210230 (+ 468us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.210576 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:37:28.210968 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.196424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.2:57863)
0811 01:37:28.197072 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.197092 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.197274 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.197627 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.197632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.198325 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:28.198845 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.198856 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.199905 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.199912 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.201048 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.201060 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.201866 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.201877 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.202076 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.202982 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:28.203003 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:28.204081 (+ 1078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:28.207869 (+ 3788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.207876 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.207890 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.208539 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.208978 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.208983 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.208986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.209126 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.209723 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:28.209728 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:28.209961 (+ 233us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.210125 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.210482 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":386,"threads_started":1}
I20260811 01:37:28.227439 19358 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:40115
I20260811 01:37:28.227533 19504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:40115 every 8 connection(s)
I20260811 01:37:28.228796 19358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:28.231134 19505 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40205
I20260811 01:37:28.231206 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19358
I20260811 01:37:28.231410 19505 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:28.231432 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:28.231940 17936 external_mini_cluster.cc:1428] Setting key 97d912b407e12fed37ee6d96f07d09fa
I20260811 01:37:28.232142 19505 heartbeater.cc:511] Master 127.17.132.62:40205 requested a full tablet report, sending...
I20260811 01:37:28.233630 19133 ts_manager.cc:194] Registered new tserver with Master: 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115)
I20260811 01:37:28.234665 19133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:52673
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:28.281481 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40205
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:28.631840 19510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:28.632212 19510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:28.632383 19510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:28.640232 19510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:28.640425 19510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:28.640589 19510 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:28.640741 19510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:28.653988 19510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:28.655350 19510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:28.655761 19354 heartbeater.cc:503] Master 127.17.132.62:40205 was elected leader, sending a full tablet report...
I20260811 01:37:28.656795 19510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:28.671059 19516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:28.671020 19518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:28.671186 19515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:28.671994 19510 server_base.cc:1034] running on GCE node
I20260811 01:37:28.672646 19510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:28.673772 19510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:28.675056 19510 hybrid_clock.cc:648] HybridClock initialized: now 1786412248674985 us; error 50 us; skew 500 ppm
I20260811 01:37:28.675406 19510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:28.678748 19510 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:28.680362 19510 webserver.cc:460] Webserver started at http://127.17.132.3:42337/ using document root <none> and password file <none>
I20260811 01:37:28.681095 19510 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:28.681228 19510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:28.681566 19510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:28.684633 19510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "e568792dfb474a16bb985ea54f439d3a"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "ec9beee1054a0d1169375587406e37eb"
server_key_iv: "feb78555b1066f304ecab29d88629e75"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.685503 19510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "e568792dfb474a16bb985ea54f439d3a"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "ec9beee1054a0d1169375587406e37eb"
server_key_iv: "feb78555b1066f304ecab29d88629e75"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.691684 19510 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260811 01:37:28.696108 19526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:28.697640 19510 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 01:37:28.697880 19510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "e568792dfb474a16bb985ea54f439d3a"
format_stamp: "Formatted at 2026-08-11 01:37:28 on dist-test-slave-0kls"
server_key: "ec9beee1054a0d1169375587406e37eb"
server_key_iv: "feb78555b1066f304ecab29d88629e75"
server_key_version: "encryptionkey@0"
I20260811 01:37:28.698143 19510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:28.729924 19510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:28.734793 19510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:28.735112 19510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:28.738420 19510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:28.738503 19510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:28.738677 19510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:28.738778 19510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:28.764787 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.738947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:59689 (local address 127.17.132.62:40205)
0811 01:37:28.742099 (+ 3152us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.742104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.742125 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:37:28.744611 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.744620 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.744721 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.744856 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:28.747217 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.748706 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.751249 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.751692 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.751842 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.756006 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:28.756015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:28.756023 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:28.756079 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:28.759903 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.761231 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.761240 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.761245 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.761434 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.762155 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.762166 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.762168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.762462 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:28.762656 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.763790 (+ 1134us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.764170 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3015,"thread_start_us":2915,"threads_started":1}
I20260811 01:37:28.765537 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.739877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.3:59689)
0811 01:37:28.740986 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.741043 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.744208 (+ 3165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.745210 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.745229 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.746075 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:28.746962 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.747000 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.748916 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.748921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.751063 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.751078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.751942 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.751949 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.752174 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.752884 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:28.752907 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:28.755741 (+ 2834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:28.760097 (+ 4356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.760111 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.760143 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.761041 (+ 898us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.761575 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.761580 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.761605 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.761995 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.762615 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:28.762628 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:28.763205 (+ 577us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.763622 (+ 417us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.764150 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":491,"threads_started":1}
I20260811 01:37:28.787042 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.773320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:48625 (local address 127.17.132.62:40205)
0811 01:37:28.773566 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.773575 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.774256 (+ 681us) server_negotiation.cc:407] Connection header received
0811 01:37:28.774494 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.774500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.774606 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.774722 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:28.775772 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.776511 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.777937 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.778570 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.778737 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.780747 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:28.780752 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:28.780756 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:28.780789 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:28.784121 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.784855 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.784861 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.784866 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.785008 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.785409 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.785414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.785419 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.785727 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:28.785953 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.786400 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.786666 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:37:28.787503 19602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.773291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.17.132.3:48625)
0811 01:37:28.774116 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.774143 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.774342 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.774762 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.774767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.775307 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:28.775615 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.775624 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.776679 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.776685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.777741 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.777755 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.778811 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.778818 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.779007 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.779765 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:28.779783 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:28.780517 (+ 734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:28.784271 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.784279 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.784284 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.784720 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.785134 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:28.785140 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:28.785144 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:28.785294 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:28.785903 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:28.785912 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:28.786132 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.786304 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.786704 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":408,"threads_started":1}
I20260811 01:37:28.800709 19510 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:43405
I20260811 01:37:28.800760 19657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:43405 every 8 connection(s)
I20260811 01:37:28.802146 19510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:28.804478 19658 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40205
I20260811 01:37:28.804749 19658 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:28.805421 19658 heartbeater.cc:511] Master 127.17.132.62:40205 requested a full tablet report, sending...
I20260811 01:37:28.806282 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19510
I20260811 01:37:28.806507 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:28.806944 17936 external_mini_cluster.cc:1428] Setting key c6b1c4cb2f60273b431d7fad6a441dc1
I20260811 01:37:28.806979 19133 ts_manager.cc:194] Registered new tserver with Master: e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405)
I20260811 01:37:28.808077 19133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:59689
I20260811 01:37:28.810204 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:37:28 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:28.866196 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.850932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.17.132.62:40205)
0811 01:37:28.851239 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.851246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.851487 (+ 241us) server_negotiation.cc:407] Connection header received
0811 01:37:28.851780 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.851784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.851855 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.851984 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:28.853567 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.854405 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.855735 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.856189 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.856340 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.860485 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:28.860490 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:28.860493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:28.860531 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:28.863342 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.863989 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.863993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.863995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.864147 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:28.864640 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:28.864643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:28.864645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:28.864920 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:28.865327 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.865641 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.865905 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260811 01:37:28.870937 19133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:28.878257 19133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:28.909076 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.891860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40115 (local address 127.0.0.1:47558)
0811 01:37:28.893909 (+ 2049us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.893971 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.894215 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.897529 (+ 3314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.897541 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.897586 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:28.898169 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.898188 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.902342 (+ 4154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.902351 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.905711 (+ 3360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.905726 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.907921 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.907929 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.908195 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.908252 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.908406 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.908621 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1271,"thread_start_us":1852,"threads_started":1}
I20260811 01:37:28.909744 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.892012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47558 (local address 127.17.132.2:40115)
0811 01:37:28.893584 (+ 1572us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.893593 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.896410 (+ 2817us) server_negotiation.cc:407] Connection header received
0811 01:37:28.896562 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.896573 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.896947 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.897205 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:28.898441 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.902112 (+ 3671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.905930 (+ 3818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.907446 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.907580 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.907793 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.908469 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.909436 (+ 967us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1405,"thread_start_us":1257,"threads_started":1}
I20260811 01:37:28.912611 19672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.892327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:33145 (local address 127.0.0.1:47028)
0811 01:37:28.894045 (+ 1718us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.894065 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.894349 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.905173 (+ 10824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.905177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.905199 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:28.905526 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.905535 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.907121 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.907127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.909855 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.909870 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.911797 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.911803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.911960 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.912000 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.912122 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.912273 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1561,"thread_start_us":840,"threads_started":1}
I20260811 01:37:28.912657 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.892976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47028 (local address 127.17.132.1:33145)
0811 01:37:28.903935 (+ 10959us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.903947 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.903987 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:37:28.904122 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.904134 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.904552 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.904945 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:28.905704 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.906968 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.910080 (+ 3112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.911575 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.911746 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.911961 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.912189 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.912342 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10741,"thread_start_us":10576,"threads_started":1}
I20260811 01:37:28.914201 19676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.894179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43405 (local address 127.0.0.1:55722)
0811 01:37:28.902771 (+ 8592us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:28.902798 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:28.903273 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:28.905754 (+ 2481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:28.905759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:28.905810 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:28.906200 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.906213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.908169 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.908174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.911430 (+ 3256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:28.911446 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.913396 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.913402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:28.913579 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.913613 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:37:28.913707 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:37:28.913878 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8366,"thread_start_us":8744,"threads_started":1}
I20260811 01:37:28.914343 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:28.894886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55722 (local address 127.17.132.3:43405)
0811 01:37:28.905192 (+ 10306us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:28.905200 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:28.905233 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:37:28.905323 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:28.905330 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:28.905537 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:28.905747 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:28.906424 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.908001 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.911602 (+ 3601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:28.913180 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:28.913313 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:28.913531 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:28.913817 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:37:28.914002 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10114,"thread_start_us":9946,"threads_started":1}
I20260811 01:37:28.914259 19428 tablet_service.cc:1467] Processing CreateTablet for tablet b73b53bf388242889ead99a6700eb7cd (DEFAULT_TABLE table=test-table [id=7805786d530349cda0ac457bd612924e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:28.916141 19428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b53bf388242889ead99a6700eb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:28.916241 19279 tablet_service.cc:1467] Processing CreateTablet for tablet b73b53bf388242889ead99a6700eb7cd (DEFAULT_TABLE table=test-table [id=7805786d530349cda0ac457bd612924e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:28.917379 19279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b53bf388242889ead99a6700eb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:28.921475 19583 tablet_service.cc:1467] Processing CreateTablet for tablet b73b53bf388242889ead99a6700eb7cd (DEFAULT_TABLE table=test-table [id=7805786d530349cda0ac457bd612924e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:28.922964 19583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b53bf388242889ead99a6700eb7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:28.928918 19678 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Bootstrap starting.
I20260811 01:37:28.931016 19679 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Bootstrap starting.
I20260811 01:37:28.934871 19678 tablet_bootstrap.cc:654] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:28.934867 19679 tablet_bootstrap.cc:654] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:28.936233 19679 log.cc:824] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:28.936234 19678 log.cc:824] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:28.937263 19680 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Bootstrap starting.
I20260811 01:37:28.940431 19680 tablet_bootstrap.cc:654] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:28.942046 19680 log.cc:824] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:28.943617 19679 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: No bootstrap required, opened a new log
I20260811 01:37:28.943918 19679 ts_tablet_manager.cc:1397] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.006s
I20260811 01:37:28.944933 19678 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: No bootstrap required, opened a new log
I20260811 01:37:28.945421 19678 ts_tablet_manager.cc:1397] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20260811 01:37:28.956020 19680 tablet_bootstrap.cc:492] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: No bootstrap required, opened a new log
I20260811 01:37:28.956403 19680 ts_tablet_manager.cc:1397] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20260811 01:37:28.956283 19679 raft_consensus.cc:348] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.956786 19679 raft_consensus.cc:374] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:28.956887 19679 raft_consensus.cc:729] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d4876df659452187ccc4abe16a6610, State: Initialized, Role: FOLLOWER
I20260811 01:37:28.957659 19679 consensus_queue.cc:260] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.959242 19678 raft_consensus.cc:348] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.959743 19678 raft_consensus.cc:374] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:28.959918 19678 raft_consensus.cc:729] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f50bc45a89458982d34592d247a9e2, State: Initialized, Role: FOLLOWER
I20260811 01:37:28.960611 19678 consensus_queue.cc:260] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.965853 19679 ts_tablet_manager.cc:1428] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Time spent starting tablet: real 0.022s user 0.014s sys 0.008s
I20260811 01:37:28.966243 19505 heartbeater.cc:503] Master 127.17.132.62:40205 was elected leader, sending a full tablet report...
I20260811 01:37:28.970458 19680 raft_consensus.cc:348] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.970963 19680 raft_consensus.cc:374] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:28.971079 19680 raft_consensus.cc:729] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e568792dfb474a16bb985ea54f439d3a, State: Initialized, Role: FOLLOWER
I20260811 01:37:28.971508 19678 ts_tablet_manager.cc:1428] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Time spent starting tablet: real 0.026s user 0.010s sys 0.015s
I20260811 01:37:28.971796 19680 consensus_queue.cc:260] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:28.972977 19658 heartbeater.cc:503] Master 127.17.132.62:40205 was elected leader, sending a full tablet report...
I20260811 01:37:28.973729 19680 ts_tablet_manager.cc:1428] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Time spent starting tablet: real 0.017s user 0.015s sys 0.004s
W20260811 01:37:28.980854 19507 tablet.cc:2369] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:37:29.054179 19659 tablet.cc:2369] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:37:29.147785 19355 tablet.cc:2369] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:29.401044 19686 raft_consensus.cc:482] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:29.401448 19686 raft_consensus.cc:504] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:29.403210 19688 raft_consensus.cc:482] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:29.404066 19688 raft_consensus.cc:504] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:29.411201 19686 leader_election.cc:288] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405), b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145)
I20260811 01:37:29.415988 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.405015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:57321 (local address 127.17.132.3:43405)
0811 01:37:29.405249 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.405257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.405327 (+ 70us) server_negotiation.cc:407] Connection header received
0811 01:37:29.405414 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.405422 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.405518 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.405624 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.406470 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.407931 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.412462 (+ 4531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.414356 (+ 1894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.414523 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.414619 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.415410 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.415614 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:37:29.417011 19689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.404120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43405 (local address 127.17.132.2:57321)
0811 01:37:29.405033 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.405063 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.405224 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.405670 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.405677 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.405716 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.406238 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.406255 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.408189 (+ 1934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.408198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.412206 (+ 4008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.412229 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.414886 (+ 2657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.414895 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.415149 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.415210 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.416296 (+ 1086us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.416519 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":563,"threads_started":1}
I20260811 01:37:29.418064 19611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "10d4876df659452187ccc4abe16a6610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e568792dfb474a16bb985ea54f439d3a" is_pre_election: true
I20260811 01:37:29.418555 19611 raft_consensus.cc:2454] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d4876df659452187ccc4abe16a6610 in term 0.
I20260811 01:37:29.419415 19376 leader_election.cc:302] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d4876df659452187ccc4abe16a6610, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.419909 19686 raft_consensus.cc:2781] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:29.420058 19686 raft_consensus.cc:482] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:29.420190 19686 raft_consensus.cc:3037] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.422920 19687 raft_consensus.cc:482] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:29.423204 19687 raft_consensus.cc:504] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:29.427188 19688 leader_election.cc:288] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115), b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145)
I20260811 01:37:29.428968 19687 leader_election.cc:288] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115), e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405)
I20260811 01:37:29.422658 19686 raft_consensus.cc:504] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:29.433589 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.406078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:32799 (local address 127.17.132.1:33145)
0811 01:37:29.406322 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.406330 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.417377 (+ 11047us) server_negotiation.cc:407] Connection header received
0811 01:37:29.417549 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.417561 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.417665 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.417802 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.423978 (+ 6176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.425155 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.428672 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.429874 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.430073 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.430157 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.433166 (+ 3009us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.433326 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:37:29.434854 19611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "10d4876df659452187ccc4abe16a6610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e568792dfb474a16bb985ea54f439d3a"
I20260811 01:37:29.435146 19611 raft_consensus.cc:3037] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.439075 19611 raft_consensus.cc:2454] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d4876df659452187ccc4abe16a6610 in term 1.
I20260811 01:37:29.439608 19376 leader_election.cc:302] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d4876df659452187ccc4abe16a6610, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.442101 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.409272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:60809 (local address 127.17.132.2:40115)
0811 01:37:29.409863 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.409871 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.431286 (+ 21415us) server_negotiation.cc:407] Connection header received
0811 01:37:29.431653 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.431659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.431739 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.431804 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.432732 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.433884 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.438808 (+ 4924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.440201 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.440400 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.440517 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.441442 (+ 925us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.441656 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397}
I20260811 01:37:29.445839 19689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.405482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:33145 (local address 127.17.132.2:32799)
0811 01:37:29.417292 (+ 11810us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.417311 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.417429 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.423481 (+ 6052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.423490 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.423536 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.423773 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.423788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.425660 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.425666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.428375 (+ 2709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.428402 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.432050 (+ 3648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.432057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.432265 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.432315 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.433748 (+ 1433us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.445472 (+ 11724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11705,"thread_start_us":26246,"threads_started":1}
I20260811 01:37:29.446591 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.431116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:39649 (local address 127.17.132.3:43405)
0811 01:37:29.431314 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.431322 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.431976 (+ 654us) server_negotiation.cc:407] Connection header received
0811 01:37:29.432285 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.432293 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.432387 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.432455 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.433416 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.434872 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.443362 (+ 8490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.444924 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.445078 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.445198 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.446028 (+ 830us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.446239 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:37:29.447001 19306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "10d4876df659452187ccc4abe16a6610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f50bc45a89458982d34592d247a9e2" is_pre_election: true
I20260811 01:37:29.447576 19306 raft_consensus.cc:2454] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d4876df659452187ccc4abe16a6610 in term 0.
I20260811 01:37:29.447733 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.430808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43405 (local address 127.17.132.1:39649)
0811 01:37:29.431865 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.431886 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.432096 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.432695 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.432702 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.432743 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.433223 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.433237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.435191 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.435199 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.442753 (+ 7554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.442775 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.445435 (+ 2660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.445444 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.445755 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.445839 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.446906 (+ 1067us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.447144 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":1,"thread_start_us":750,"threads_started":1}
I20260811 01:37:29.447978 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.408623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40115 (local address 127.17.132.3:60809)
0811 01:37:29.431072 (+ 22449us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.431182 (+ 110us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.431483 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.432073 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.432077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.432109 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.432486 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.432502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.434307 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.434315 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.438589 (+ 4274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.438606 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.440838 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.440847 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.441173 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.441231 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.447146 (+ 5915us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.447388 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22250,"mutex_wait_us":1,"thread_start_us":27964,"threads_started":1}
I20260811 01:37:29.449245 19611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e568792dfb474a16bb985ea54f439d3a" is_pre_election: true
I20260811 01:37:29.449381 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610" is_pre_election: true
I20260811 01:37:29.449658 19611 raft_consensus.cc:2379] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f50bc45a89458982d34592d247a9e2 in current term 1: Already voted for candidate 10d4876df659452187ccc4abe16a6610 in this term.
I20260811 01:37:29.449934 19455 raft_consensus.cc:2379] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e568792dfb474a16bb985ea54f439d3a in current term 1: Already voted for candidate 10d4876df659452187ccc4abe16a6610 in this term.
I20260811 01:37:29.450717 19686 leader_election.cc:288] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [CANDIDATE]: Term 1 election: Requested vote from peers e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405), b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145)
I20260811 01:37:29.450941 19686 raft_consensus.cc:2781] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:29.451094 19686 raft_consensus.cc:686] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 LEADER]: Becoming Leader. State: Replica: 10d4876df659452187ccc4abe16a6610, State: Running, Role: LEADER
I20260811 01:37:29.453034 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.432588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:59549 (local address 127.17.132.2:40115)
0811 01:37:29.442416 (+ 9828us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.442424 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.442448 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:37:29.442521 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.442529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.442633 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.442743 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.444037 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.445459 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.449804 (+ 4345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.451581 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.451781 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.451852 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.452536 (+ 684us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.452675 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9684,"thread_start_us":13431,"threads_started":1}
I20260811 01:37:29.452936 19306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "10d4876df659452187ccc4abe16a6610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f50bc45a89458982d34592d247a9e2"
I20260811 01:37:29.453204 19306 raft_consensus.cc:3037] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.454167 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.425614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40115 (local address 127.17.132.1:59549)
0811 01:37:29.430365 (+ 4751us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.430392 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.430520 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.443293 (+ 12773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.443301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.443348 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.443790 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.443805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.445649 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.445655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.449408 (+ 3753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.449425 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.452005 (+ 2580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.452011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.452190 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.452221 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.452318 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.453404 (+ 1086us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4598,"thread_start_us":4548,"threads_started":1}
I20260811 01:37:29.456017 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.415726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:48351 (local address 127.17.132.1:33145)
0811 01:37:29.418099 (+ 2373us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.418105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.435746 (+ 17641us) server_negotiation.cc:407] Connection header received
0811 01:37:29.436032 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.436038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.436116 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.436194 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:29.437023 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.438455 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.452334 (+ 13879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.454331 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.454550 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.454655 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.455549 (+ 894us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.455695 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2209,"thread_start_us":2189,"threads_started":1}
I20260811 01:37:29.456188 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.415319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:33145 (local address 127.17.132.3:48351)
0811 01:37:29.435644 (+ 20325us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.435665 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.435843 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.436322 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.436327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.436352 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:29.436812 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.436833 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.438666 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.438675 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.452073 (+ 13398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.452096 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.455035 (+ 2939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.455045 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.455325 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.455376 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.455491 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.455684 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20181,"mutex_wait_us":10751,"thread_start_us":15413,"threads_started":1}
I20260811 01:37:29.456606 19306 raft_consensus.cc:2454] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d4876df659452187ccc4abe16a6610 in term 1.
I20260811 01:37:29.457044 19306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f50bc45a89458982d34592d247a9e2" is_pre_election: true
I20260811 01:37:29.457367 19306 raft_consensus.cc:2379] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e568792dfb474a16bb985ea54f439d3a in current term 1: Already voted for candidate 10d4876df659452187ccc4abe16a6610 in this term.
I20260811 01:37:29.457258 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b53bf388242889ead99a6700eb7cd" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610" is_pre_election: true
I20260811 01:37:29.457923 19227 leader_election.cc:302] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f50bc45a89458982d34592d247a9e2; no voters: 10d4876df659452187ccc4abe16a6610, e568792dfb474a16bb985ea54f439d3a
I20260811 01:37:29.458071 19528 leader_election.cc:302] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e568792dfb474a16bb985ea54f439d3a; no voters: 10d4876df659452187ccc4abe16a6610, b0f50bc45a89458982d34592d247a9e2
I20260811 01:37:29.451730 19686 consensus_queue.cc:237] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } }
I20260811 01:37:29.458797 19688 raft_consensus.cc:2726] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 01:37:29.459105 19687 raft_consensus.cc:2726] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 01:37:29.463888 19133 catalog_manager.cc:5495] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d4876df659452187ccc4abe16a6610 (127.17.132.2). New cstate: current_term: 1 leader_uuid: "10d4876df659452187ccc4abe16a6610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260811 01:37:29.619722 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.613120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.17.132.2:40115)
0811 01:37:29.613314 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.613319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.613973 (+ 654us) server_negotiation.cc:407] Connection header received
0811 01:37:29.614242 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.614246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.614349 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.614520 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:29.615047 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.615748 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.617268 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.617701 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.617888 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.618431 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:29.619020 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:29.619199 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.619328 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.619421 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:37:29.628394 19611 raft_consensus.cc:1261] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Refusing update from remote peer 10d4876df659452187ccc4abe16a6610: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:29.628427 19306 raft_consensus.cc:1261] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Refusing update from remote peer 10d4876df659452187ccc4abe16a6610: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:29.629537 19699 consensus_queue.cc:1035] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:29.630072 19686 consensus_queue.cc:1035] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:29.644562 19707 mvcc.cc:205] Tried to move back new op lower bound from 7317144574467710976 to 7317144573785231360. Current Snapshot: MvccSnapshot[applied={T|T < 7317144574467710976}]
I20260811 01:37:29.670699 19134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:29.671075 19134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:29.675180 19134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Sending DeleteTablet for 3 replicas of tablet b73b53bf388242889ead99a6700eb7cd
I20260811 01:37:29.676532 19279 tablet_service.cc:1514] Processing DeleteTablet for tablet b73b53bf388242889ead99a6700eb7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:29 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47028
I20260811 01:37:29.676540 19428 tablet_service.cc:1514] Processing DeleteTablet for tablet b73b53bf388242889ead99a6700eb7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:29 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47558
I20260811 01:37:29.677580 19717 tablet_replica.cc:330] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: stopping tablet replica
I20260811 01:37:29.677474 19583 tablet_service.cc:1514] Processing DeleteTablet for tablet b73b53bf388242889ead99a6700eb7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:29 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55722
I20260811 01:37:29.678280 19718 tablet_replica.cc:330] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: stopping tablet replica
I20260811 01:37:29.678797 19718 raft_consensus.cc:2229] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:29.679306 19717 raft_consensus.cc:2229] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:29.680130 19717 raft_consensus.cc:2258] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:29.680735 19718 raft_consensus.cc:2258] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:29.680883 19133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:29.681876 19133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:29.683650 19718 ts_tablet_manager.cc:1905] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:29.685479 19717 ts_tablet_manager.cc:1905] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:29.693437 19428 tablet_service.cc:1467] Processing CreateTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 (DEFAULT_TABLE table=test-table [id=b3e6657766214174a6a7bda8595e6eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:29.693439 19279 tablet_service.cc:1467] Processing CreateTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 (DEFAULT_TABLE table=test-table [id=b3e6657766214174a6a7bda8595e6eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:29.693619 19582 tablet_service.cc:1467] Processing CreateTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 (DEFAULT_TABLE table=test-table [id=b3e6657766214174a6a7bda8595e6eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:29.694000 19428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c59d23e8db4f7ebfe7a75c0f402207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.694024 19279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c59d23e8db4f7ebfe7a75c0f402207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.694209 19582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c59d23e8db4f7ebfe7a75c0f402207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.699334 19717 ts_tablet_manager.cc:1918] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:37:29.703850 19718 ts_tablet_manager.cc:1918] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:37:29.704197 19718 log.cc:1196] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/b73b53bf388242889ead99a6700eb7cd
I20260811 01:37:29.704916 19718 ts_tablet_manager.cc:1939] T b73b53bf388242889ead99a6700eb7cd P b0f50bc45a89458982d34592d247a9e2: Deleting consensus metadata
I20260811 01:37:29.705171 19717 log.cc:1196] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/b73b53bf388242889ead99a6700eb7cd
I20260811 01:37:29.705880 19717 ts_tablet_manager.cc:1939] T b73b53bf388242889ead99a6700eb7cd P 10d4876df659452187ccc4abe16a6610: Deleting consensus metadata
I20260811 01:37:29.707976 19116 catalog_manager.cc:4841] TS b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145): tablet b73b53bf388242889ead99a6700eb7cd (table test-table [id=7805786d530349cda0ac457bd612924e]) successfully deleted
I20260811 01:37:29.710022 19118 catalog_manager.cc:4841] TS 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115): tablet b73b53bf388242889ead99a6700eb7cd (table test-table [id=7805786d530349cda0ac457bd612924e]) successfully deleted
I20260811 01:37:29.710875 19721 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Bootstrap starting.
I20260811 01:37:29.711537 19720 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Bootstrap starting.
I20260811 01:37:29.713315 19719 tablet_replica.cc:330] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: stopping tablet replica
I20260811 01:37:29.713362 19721 tablet_bootstrap.cc:654] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.714537 19722 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Bootstrap starting.
I20260811 01:37:29.714576 19720 tablet_bootstrap.cc:654] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.714851 19719 raft_consensus.cc:2229] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:29.715464 19719 raft_consensus.cc:2258] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:29.718185 19722 tablet_bootstrap.cc:654] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.719154 19720 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: No bootstrap required, opened a new log
I20260811 01:37:29.719326 19720 ts_tablet_manager.cc:1397] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 01:37:29.719360 19719 ts_tablet_manager.cc:1905] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:29.720423 19720 raft_consensus.cc:348] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.720731 19720 raft_consensus.cc:374] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.720844 19720 raft_consensus.cc:729] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d4876df659452187ccc4abe16a6610, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.722517 19720 consensus_queue.cc:260] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.725975 19720 ts_tablet_manager.cc:1428] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 01:37:29.727358 19722 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: No bootstrap required, opened a new log
I20260811 01:37:29.727429 19719 ts_tablet_manager.cc:1918] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:37:29.727630 19719 log.cc:1196] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/b73b53bf388242889ead99a6700eb7cd
I20260811 01:37:29.728188 19722 ts_tablet_manager.cc:1397] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260811 01:37:29.728268 19719 ts_tablet_manager.cc:1939] T b73b53bf388242889ead99a6700eb7cd P e568792dfb474a16bb985ea54f439d3a: Deleting consensus metadata
I20260811 01:37:29.729352 19722 raft_consensus.cc:348] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.729655 19722 raft_consensus.cc:374] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.729758 19722 raft_consensus.cc:729] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f50bc45a89458982d34592d247a9e2, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.730067 19722 consensus_queue.cc:260] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.730808 19722 ts_tablet_manager.cc:1428] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:37:29.730949 19721 tablet_bootstrap.cc:492] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: No bootstrap required, opened a new log
I20260811 01:37:29.731113 19721 ts_tablet_manager.cc:1397] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.005s
I20260811 01:37:29.732179 19721 raft_consensus.cc:348] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.732460 19721 raft_consensus.cc:374] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.732640 19721 raft_consensus.cc:729] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e568792dfb474a16bb985ea54f439d3a, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.732931 19721 consensus_queue.cc:260] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.733263 19118 catalog_manager.cc:4841] TS e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405): tablet b73b53bf388242889ead99a6700eb7cd (table test-table [id=7805786d530349cda0ac457bd612924e]) successfully deleted
I20260811 01:37:29.733610 19721 ts_tablet_manager.cc:1428] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 01:37:29.779758 19687 raft_consensus.cc:482] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:29.779996 19687 raft_consensus.cc:504] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.780691 19687 leader_election.cc:288] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115), e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405)
I20260811 01:37:29.781414 19611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c59d23e8db4f7ebfe7a75c0f402207" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e568792dfb474a16bb985ea54f439d3a" is_pre_election: true
I20260811 01:37:29.781422 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c59d23e8db4f7ebfe7a75c0f402207" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610" is_pre_election: true
I20260811 01:37:29.781692 19611 raft_consensus.cc:2454] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f50bc45a89458982d34592d247a9e2 in term 0.
I20260811 01:37:29.781761 19455 raft_consensus.cc:2454] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f50bc45a89458982d34592d247a9e2 in term 0.
I20260811 01:37:29.782184 19227 leader_election.cc:302] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f50bc45a89458982d34592d247a9e2, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.782527 19687 raft_consensus.cc:2781] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:29.782675 19687 raft_consensus.cc:482] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:29.782799 19687 raft_consensus.cc:3037] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.785317 19687 raft_consensus.cc:504] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.785988 19687 leader_election.cc:288] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 election: Requested vote from peers 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115), e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405)
I20260811 01:37:29.786574 19611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c59d23e8db4f7ebfe7a75c0f402207" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e568792dfb474a16bb985ea54f439d3a"
I20260811 01:37:29.786574 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c59d23e8db4f7ebfe7a75c0f402207" candidate_uuid: "b0f50bc45a89458982d34592d247a9e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610"
I20260811 01:37:29.786789 19611 raft_consensus.cc:3037] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.786814 19455 raft_consensus.cc:3037] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.789259 19611 raft_consensus.cc:2454] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f50bc45a89458982d34592d247a9e2 in term 1.
I20260811 01:37:29.789753 19227 leader_election.cc:302] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f50bc45a89458982d34592d247a9e2, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.790167 19687 raft_consensus.cc:2781] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:29.790285 19455 raft_consensus.cc:2454] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f50bc45a89458982d34592d247a9e2 in term 1.
I20260811 01:37:29.790983 19687 raft_consensus.cc:686] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 1 LEADER]: Becoming Leader. State: Replica: b0f50bc45a89458982d34592d247a9e2, State: Running, Role: LEADER
I20260811 01:37:29.791597 19687 consensus_queue.cc:237] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.795768 19134 catalog_manager.cc:5495] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f50bc45a89458982d34592d247a9e2 (127.17.132.1). New cstate: current_term: 1 leader_uuid: "b0f50bc45a89458982d34592d247a9e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:37:29 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412246, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:29.848577 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.832517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40205 (local address 127.0.0.1:51278)
0811 01:37:29.833509 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.833525 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.833711 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.834164 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.834169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.835091 (+ 922us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:29.835296 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.835307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.836423 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.836430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.837425 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.837438 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.838279 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.838285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.838475 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.839276 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:29.839296 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:29.842151 (+ 2855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:29.845615 (+ 3464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:29.845632 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:29.845640 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:29.846171 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:29.846563 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:29.846568 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:29.846571 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:29.846723 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:29.847316 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:29.847325 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:29.847506 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.847694 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.848043 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":698,"threads_started":1}
I20260811 01:37:29.848600 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.832502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.17.132.62:40205)
0811 01:37:29.833369 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.833378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.833625 (+ 247us) server_negotiation.cc:407] Connection header received
0811 01:37:29.833876 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.833887 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.834012 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.834137 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:29.835472 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.836268 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.837579 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.838100 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.838232 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.842411 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:29.842417 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:29.842421 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:29.842456 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:29.845444 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:29.846297 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:29.846304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:29.846307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:29.846441 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:29.846840 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:29.846845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:29.846850 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:29.847187 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:29.847340 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.847797 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.848182 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":683,"thread_start_us":476,"threads_started":1}
I20260811 01:37:29.855218 19134 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51278:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:37:29.856791 19134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:29.864418 19279 tablet_service.cc:1467] Processing CreateTablet for tablet 29b85b2a42474d97add63f739709a103 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8edffef6ea63435f9ac093c910a6f601]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:29.864979 19279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b85b2a42474d97add63f739709a103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.868371 19582 tablet_service.cc:1467] Processing CreateTablet for tablet 29b85b2a42474d97add63f739709a103 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8edffef6ea63435f9ac093c910a6f601]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:29.868371 19428 tablet_service.cc:1467] Processing CreateTablet for tablet 29b85b2a42474d97add63f739709a103 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8edffef6ea63435f9ac093c910a6f601]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:29.869001 19428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b85b2a42474d97add63f739709a103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.869016 19582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29b85b2a42474d97add63f739709a103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:29.872684 19722 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: Bootstrap starting.
I20260811 01:37:29.874571 19722 tablet_bootstrap.cc:654] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.877763 19721 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: Bootstrap starting.
I20260811 01:37:29.879622 19721 tablet_bootstrap.cc:654] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.880762 19720 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: Bootstrap starting.
I20260811 01:37:29.881713 19722 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: No bootstrap required, opened a new log
I20260811 01:37:29.881934 19722 ts_tablet_manager.cc:1397] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:37:29.882649 19720 tablet_bootstrap.cc:654] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:29.882629 19722 raft_consensus.cc:348] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.882938 19722 raft_consensus.cc:374] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.883037 19722 raft_consensus.cc:729] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f50bc45a89458982d34592d247a9e2, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.883292 19722 consensus_queue.cc:260] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.883879 19722 ts_tablet_manager.cc:1428] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:37:29.883780 19687 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:29.884111 19687 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:29.887614 19720 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: No bootstrap required, opened a new log
I20260811 01:37:29.887810 19720 ts_tablet_manager.cc:1397] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260811 01:37:29.888177 19721 tablet_bootstrap.cc:492] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: No bootstrap required, opened a new log
I20260811 01:37:29.888396 19721 ts_tablet_manager.cc:1397] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20260811 01:37:29.888676 19720 raft_consensus.cc:348] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.888984 19720 raft_consensus.cc:374] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.889058 19720 raft_consensus.cc:729] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d4876df659452187ccc4abe16a6610, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.889369 19720 consensus_queue.cc:260] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.889267 19721 raft_consensus.cc:348] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.889976 19712 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:29.890359 19721 raft_consensus.cc:374] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:29.890475 19712 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:29.890453 19721 raft_consensus.cc:729] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e568792dfb474a16bb985ea54f439d3a, State: Initialized, Role: FOLLOWER
I20260811 01:37:29.890740 19721 consensus_queue.cc:260] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.891135 19720 ts_tablet_manager.cc:1428] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 01:37:29.891305 19721 ts_tablet_manager.cc:1428] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 01:37:29.891212 19688 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:29.891479 19688 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:29.946415 19688 raft_consensus.cc:482] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:29.946627 19688 raft_consensus.cc:504] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.947441 19688 leader_election.cc:288] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145), 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115)
I20260811 01:37:29.948069 19306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b85b2a42474d97add63f739709a103" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f50bc45a89458982d34592d247a9e2" is_pre_election: true
I20260811 01:37:29.948248 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b85b2a42474d97add63f739709a103" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610" is_pre_election: true
I20260811 01:37:29.948375 19306 raft_consensus.cc:2454] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e568792dfb474a16bb985ea54f439d3a in term 0.
I20260811 01:37:29.948494 19455 raft_consensus.cc:2454] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e568792dfb474a16bb985ea54f439d3a in term 0.
I20260811 01:37:29.948937 19528 leader_election.cc:302] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f50bc45a89458982d34592d247a9e2, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.949386 19688 raft_consensus.cc:2781] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:29.949502 19688 raft_consensus.cc:482] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:29.949597 19688 raft_consensus.cc:3037] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.952912 19688 raft_consensus.cc:504] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.953758 19688 leader_election.cc:288] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 election: Requested vote from peers b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145), 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115)
I20260811 01:37:29.954263 19306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b85b2a42474d97add63f739709a103" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f50bc45a89458982d34592d247a9e2"
I20260811 01:37:29.954411 19455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29b85b2a42474d97add63f739709a103" candidate_uuid: "e568792dfb474a16bb985ea54f439d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d4876df659452187ccc4abe16a6610"
I20260811 01:37:29.954499 19306 raft_consensus.cc:3037] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.954612 19455 raft_consensus.cc:3037] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:29.957669 19306 raft_consensus.cc:2454] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e568792dfb474a16bb985ea54f439d3a in term 1.
I20260811 01:37:29.958231 19528 leader_election.cc:302] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0f50bc45a89458982d34592d247a9e2, e568792dfb474a16bb985ea54f439d3a; no voters:
I20260811 01:37:29.958745 19455 raft_consensus.cc:2454] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e568792dfb474a16bb985ea54f439d3a in term 1.
I20260811 01:37:29.959434 19688 raft_consensus.cc:2781] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:29.962128 19688 raft_consensus.cc:686] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [term 1 LEADER]: Becoming Leader. State: Replica: e568792dfb474a16bb985ea54f439d3a, State: Running, Role: LEADER
I20260811 01:37:29.962561 19688 consensus_queue.cc:237] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } }
I20260811 01:37:29.964697 19738 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: TxnStatusTablet state changed. Reason: New leader e568792dfb474a16bb985ea54f439d3a. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:29.965081 19738 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:29.965888 19740 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:37:29.966192 19740 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:37:29.966904 19133 catalog_manager.cc:5495] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to e568792dfb474a16bb985ea54f439d3a (127.17.132.3). New cstate: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } health_report { overall_health: HEALTHY } } }
I20260811 01:37:29.998497 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.988950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43405 (local address 127.0.0.1:55724)
0811 01:37:29.989192 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:29.989214 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:29.989354 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:29.990882 (+ 1528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:29.990887 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:29.990902 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:29.991135 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.991149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.992905 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.992911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.994684 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:29.994719 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.996208 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.996215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:29.996416 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.996507 (+ 91us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:29.997837 (+ 1330us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:29.997867 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:37:29.997967 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:37:29.998150 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:37:29.998550 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:29.988927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55724 (local address 127.17.132.3:43405)
0811 01:37:29.990374 (+ 1447us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:29.990380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:29.990407 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:37:29.990510 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:29.990517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:29.990645 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:29.990832 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:29.991333 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.992747 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.994884 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:29.995961 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:29.996221 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:29.996777 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:29.997673 (+ 896us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:29.997865 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:29.998006 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:37:29.998101 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1293,"thread_start_us":1048,"threads_started":1}
I20260811 01:37:30.004884 19306 raft_consensus.cc:1261] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Refusing update from remote peer e568792dfb474a16bb985ea54f439d3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:30.005926 19738 consensus_queue.cc:1035] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:30.012784 19455 raft_consensus.cc:1261] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Refusing update from remote peer e568792dfb474a16bb985ea54f439d3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:30.013865 19738 consensus_queue.cc:1035] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:30.023283 19687 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: TxnStatusTablet state changed. Reason: New leader e568792dfb474a16bb985ea54f439d3a. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.023629 19687 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:30.024449 19712 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: TxnStatusTablet state changed. Reason: New leader e568792dfb474a16bb985ea54f439d3a. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.024796 19712 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:30.031055 19687 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.031466 19687 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P b0f50bc45a89458982d34592d247a9e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:30.033491 19706 mvcc.cc:205] Tried to move back new op lower bound from 7317144576010342400 to 7317144575851020288. Current Snapshot: MvccSnapshot[applied={T|T < 7317144576010342400 or (T in {7317144576010342400})}]
I20260811 01:37:30.034327 19712 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.034624 19712 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P 10d4876df659452187ccc4abe16a6610: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:30.041692 19688 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.042137 19688 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:30.043525 19738 tablet_replica.cc:439] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e568792dfb474a16bb985ea54f439d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f50bc45a89458982d34592d247a9e2" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 33145 } } peers { permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 } } peers { permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 } } }
I20260811 01:37:30.043934 19738 tablet_replica.cc:442] T 29b85b2a42474d97add63f739709a103 P e568792dfb474a16bb985ea54f439d3a: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:30.052122 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.042096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47032 (local address 127.17.132.1:33145)
0811 01:37:30.044663 (+ 2567us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.044670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.044693 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:37:30.044812 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.044818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.044944 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.045664 (+ 720us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:30.045891 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.047081 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.049129 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.049859 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.050014 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.050569 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:30.051352 (+ 783us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:30.051531 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.051641 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.051738 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2416,"thread_start_us":2251,"threads_started":1}
I20260811 01:37:30.074106 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.066136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:37423 (local address 127.17.132.3:43405)
0811 01:37:30.066491 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.066501 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.066974 (+ 473us) server_negotiation.cc:407] Connection header received
0811 01:37:30.067213 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.067221 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.067315 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.067417 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:30.068286 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.069545 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.071726 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.072479 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.072629 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.073200 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:30.073355 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:30.073465 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.073646 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.073738 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260811 01:37:30.074450 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.066073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43405 (local address 127.17.132.1:37423)
0811 01:37:30.066847 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:30.066869 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:30.067049 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:30.067630 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:30.067636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:30.067651 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:30.068096 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:30.068111 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.069719 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.069725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:30.071538 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:30.071556 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.072679 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.072686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:30.072897 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.072986 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:30.073490 (+ 504us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:30.073504 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 01:37:30.073604 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:37:30.073775 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":438,"threads_started":1}
I20260811 01:37:30.088390 19611 raft_consensus.cc:1261] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Refusing update from remote peer b0f50bc45a89458982d34592d247a9e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:30.088567 19455 raft_consensus.cc:1261] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Refusing update from remote peer b0f50bc45a89458982d34592d247a9e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:30.089327 19726 consensus_queue.cc:1035] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e568792dfb474a16bb985ea54f439d3a" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:30.089813 19687 consensus_queue.cc:1035] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d4876df659452187ccc4abe16a6610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:30.151136 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.143809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54251 (local address 127.17.132.1:33145)
0811 01:37:30.144008 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.144014 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.144854 (+ 840us) server_negotiation.cc:407] Connection header received
0811 01:37:30.145081 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.145087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.145168 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.145275 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:30.146095 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.147195 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.149211 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.149629 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.149835 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.150351 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:30.150483 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:30.150537 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.150750 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.150832 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:37:30.151291 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.143874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:33145 (local address 127.17.132.3:54251)
0811 01:37:30.144742 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:30.144758 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:30.144935 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:30.145293 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:30.145297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:30.145309 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:30.145822 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:30.145840 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.147413 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.147418 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:30.149050 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:30.149068 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.149833 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.149840 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:30.150020 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.150104 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:30.150610 (+ 506us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:30.150618 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:37:30.150715 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:37:30.150858 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":488,"threads_started":1}
I20260811 01:37:30.207441 19133 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:30.207751 19133 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:30.212757 19133 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a53c57e179b49a8974ad65e846f7357: Sending DeleteTablet for 3 replicas of tablet 94c59d23e8db4f7ebfe7a75c0f402207
I20260811 01:37:30.214706 19428 tablet_service.cc:1514] Processing DeleteTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:30 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47558
I20260811 01:37:30.215221 19582 tablet_service.cc:1514] Processing DeleteTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:30 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55722
I20260811 01:37:30.215574 19719 tablet_replica.cc:330] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: stopping tablet replica
I20260811 01:37:30.215790 19719 raft_consensus.cc:2229] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:30.216019 19719 raft_consensus.cc:2258] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:30.217191 19279 tablet_service.cc:1514] Processing DeleteTablet for tablet 94c59d23e8db4f7ebfe7a75c0f402207 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:30 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47028
I20260811 01:37:30.217567 19719 ts_tablet_manager.cc:1905] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:30.232234 19719 ts_tablet_manager.cc:1918] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:30.232431 19719 log.cc:1196] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/94c59d23e8db4f7ebfe7a75c0f402207
I20260811 01:37:30.232914 19719 ts_tablet_manager.cc:1939] T 94c59d23e8db4f7ebfe7a75c0f402207 P e568792dfb474a16bb985ea54f439d3a: Deleting consensus metadata
I20260811 01:37:30.234259 19118 catalog_manager.cc:4841] TS e568792dfb474a16bb985ea54f439d3a (127.17.132.3:43405): tablet 94c59d23e8db4f7ebfe7a75c0f402207 (table test-table [id=b3e6657766214174a6a7bda8595e6eab]) successfully deleted
I20260811 01:37:30.250262 19762 tablet_replica.cc:330] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: stopping tablet replica
I20260811 01:37:30.250865 19761 tablet_replica.cc:330] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: stopping tablet replica
I20260811 01:37:30.251291 19761 raft_consensus.cc:2229] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:30.251597 19762 raft_consensus.cc:2229] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:30.251984 19761 raft_consensus.cc:2258] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:30.252692 19762 raft_consensus.cc:2258] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:30.254889 19762 ts_tablet_manager.cc:1905] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:30.255319 19761 ts_tablet_manager.cc:1905] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:30.271745 19762 ts_tablet_manager.cc:1918] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:30.271914 19762 log.cc:1196] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/94c59d23e8db4f7ebfe7a75c0f402207
I20260811 01:37:30.272454 19762 ts_tablet_manager.cc:1939] T 94c59d23e8db4f7ebfe7a75c0f402207 P b0f50bc45a89458982d34592d247a9e2: Deleting consensus metadata
I20260811 01:37:30.273715 19116 catalog_manager.cc:4841] TS b0f50bc45a89458982d34592d247a9e2 (127.17.132.1:33145): tablet 94c59d23e8db4f7ebfe7a75c0f402207 (table test-table [id=b3e6657766214174a6a7bda8595e6eab]) successfully deleted
I20260811 01:37:30.275748 19761 ts_tablet_manager.cc:1918] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:30.275906 19761 log.cc:1196] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/94c59d23e8db4f7ebfe7a75c0f402207
I20260811 01:37:30.276485 19761 ts_tablet_manager.cc:1939] T 94c59d23e8db4f7ebfe7a75c0f402207 P 10d4876df659452187ccc4abe16a6610: Deleting consensus metadata
I20260811 01:37:30.277689 19118 catalog_manager.cc:4841] TS 10d4876df659452187ccc4abe16a6610 (127.17.132.2:40115): tablet 94c59d23e8db4f7ebfe7a75c0f402207 (table test-table [id=b3e6657766214174a6a7bda8595e6eab]) successfully deleted
I20260811 01:37:30.280889 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.238337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47036 (local address 127.17.132.1:33145)
0811 01:37:30.238577 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.238585 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.246510 (+ 7925us) server_negotiation.cc:407] Connection header received
0811 01:37:30.246800 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.246807 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.246906 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.247052 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:30.261952 (+ 14900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.263210 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.265236 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.265970 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.266072 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.271899 (+ 5827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:30.271916 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:30.271938 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:30.271986 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:30.276860 (+ 4874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.277956 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.277967 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.277971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.278130 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.278624 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.278629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.278633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.279177 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:30.279569 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.280244 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.280493 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 01:37:30.282529 19348 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47036
I20260811 01:37:30.313023 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.293398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51294 (local address 127.17.132.62:40205)
0811 01:37:30.293680 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.293687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.294432 (+ 745us) server_negotiation.cc:407] Connection header received
0811 01:37:30.294808 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.294815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.294902 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.295000 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:30.297311 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.298536 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.300910 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.301639 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.301753 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.305526 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:30.305533 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:30.305539 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:30.305591 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:30.309213 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.310256 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.310262 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.310266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.310423 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.310893 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.310899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.310902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.311359 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:30.311646 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.312270 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.312677 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
W20260811 01:37:30.313699 19133 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51294
I20260811 01:37:30.316442 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19209
I20260811 01:37:30.338536 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.319026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.17.132.1:33145)
0811 01:37:30.319267 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.319273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.322372 (+ 3099us) server_negotiation.cc:407] Connection header received
0811 01:37:30.322533 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.322540 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.322635 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.322775 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:30.324432 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.325623 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.327557 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.328269 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.328410 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.331483 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:30.331491 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:30.331495 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:30.331537 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:30.335270 (+ 3733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.336133 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.336139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.336143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.336348 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.336801 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.336812 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.336815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.337197 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:30.337518 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.337851 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.338135 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 01:37:30.339259 19348 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47052
W20260811 01:37:30.339962 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19209: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:30.340178 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19209
I20260811 01:37:30.363686 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19358
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:30.380275 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.364585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.17.132.2:40115)
0811 01:37:30.365180 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.365184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.365200 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:37:30.365259 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.365263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.365331 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.365473 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:30.366860 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.367719 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.369117 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.369548 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.369696 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.374180 (+ 4484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:30.374197 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:30.374213 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:30.374258 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:30.377198 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.378043 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.378051 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.378054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.378207 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.378632 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.378637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.378639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.379011 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:30.379368 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.379654 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.379918 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":290,"threads_started":1}
W20260811 01:37:30.381124 19499 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47564
W20260811 01:37:30.381943 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19358: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:30.382153 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19358
I20260811 01:37:30.418398 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19510
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412248, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:30.438511 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:30.419296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.17.132.3:43405)
0811 01:37:30.419493 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:30.419497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:30.419515 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:37:30.419762 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:30.419766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:30.419834 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:30.419928 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:30.421647 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.422481 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.424386 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:30.424872 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:30.424975 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:30.431080 (+ 6105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:30.431098 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:30.431135 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:30.431184 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:30.434715 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.435750 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.435763 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.435767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.435982 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:30.436498 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:30.436502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:30.436505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:30.436931 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:30.437256 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:30.437669 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 01:37:30.437988 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 01:37:30.439422 19653 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38374
W20260811 01:37:30.440594 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19510: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:30.440795 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19510
I20260811 01:37:30.467602 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19099
I20260811 01:37:30.468860 19177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:30.587965 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19099
2026-08-11T01:37:30Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5523 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19772](info): set up 2 sockets
Aug 11 01:37:30 dist-test-slave-0kls krb5kdc[19772](info): commencing operation
krb5kdc: starting...
W20260811 01:37:31.743613 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:31 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:31.975870 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44731
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:43065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:44731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:32.328075 19786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:32.328392 19786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:32.328485 19786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:32.335903 19786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:32.336081 19786 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:37:32.336199 19786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:32.336329 19786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:32.336392 19786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:32.336458 19786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:32.347645 19786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:44731
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:32.348945 19786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:32.350350 19786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:32.362936 19794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:32.362985 19792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:32.362895 19791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:32.367653 19786 server_base.cc:1034] running on GCE node
I20260811 01:37:32.368510 19786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:32.370093 19786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:32.371383 19786 hybrid_clock.cc:648] HybridClock initialized: now 1786412252371305 us; error 29 us; skew 500 ppm
I20260811 01:37:32.371925 19786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:32 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:32.375460 19786 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:32.377246 19786 webserver.cc:460] Webserver started at http://127.17.132.62:44625/ using document root <none> and password file <none>
I20260811 01:37:32.378181 19786 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:32.378278 19786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:32.378682 19786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:32.382072 19786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "aaae36c9b0144c298f01f470c59066f7"
format_stamp: "Formatted at 2026-08-11 01:37:32 on dist-test-slave-0kls"
server_key: "1e6297ce08b28c110e4aefa28658c006"
server_key_iv: "a917048c5b7f1d1786a27c3a5b8f0e4b"
server_key_version: "encryptionkey@0"
I20260811 01:37:32.382992 19786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "aaae36c9b0144c298f01f470c59066f7"
format_stamp: "Formatted at 2026-08-11 01:37:32 on dist-test-slave-0kls"
server_key: "1e6297ce08b28c110e4aefa28658c006"
server_key_iv: "a917048c5b7f1d1786a27c3a5b8f0e4b"
server_key_version: "encryptionkey@0"
I20260811 01:37:32.388980 19786 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 01:37:32.392810 19802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:32.394413 19786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:32.394654 19786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "aaae36c9b0144c298f01f470c59066f7"
format_stamp: "Formatted at 2026-08-11 01:37:32 on dist-test-slave-0kls"
server_key: "1e6297ce08b28c110e4aefa28658c006"
server_key_iv: "a917048c5b7f1d1786a27c3a5b8f0e4b"
server_key_version: "encryptionkey@0"
I20260811 01:37:32.394876 19786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:32.421321 19786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:32.426195 19786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:32.426524 19786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:32.450682 19786 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:44731
I20260811 01:37:32.450724 19871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:44731 every 8 connection(s)
I20260811 01:37:32.452217 19786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:32.456667 19872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:32.459880 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19786
I20260811 01:37:32.460136 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:32.460805 17936 external_mini_cluster.cc:1428] Setting key 3448bde42298a63b2460c588ac72ea2c
I20260811 01:37:32.471038 19872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Bootstrap starting.
I20260811 01:37:32.475445 19872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:32.477006 19872 log.cc:824] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:37:32 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:32.480484 19872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: No bootstrap required, opened a new log
I20260811 01:37:32.487005 19875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:32.463315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51992 (local address 127.17.132.62:44731)
0811 01:37:32.464222 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:32.464234 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:32.464275 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:37:32.466223 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:32.466251 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:32.466707 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:32.467101 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:32.469261 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:32.470810 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:32.472697 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:32.473462 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:32.473614 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:32.478994 (+ 5380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:32.479003 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:32.479021 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:32.479064 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:32.482414 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:32.483246 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:32.483254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:32.483261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:32.483451 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:32.483892 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:32.483899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:32.483907 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:32.484491 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:32.484840 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:32.485342 (+ 502us) server_negotiation.cc:299] Negotiation successful
0811 01:37:32.485864 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":446,"threads_started":1}
I20260811 01:37:32.489311 19872 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } }
I20260811 01:37:32.489753 19872 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:32.489933 19872 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaae36c9b0144c298f01f470c59066f7, State: Initialized, Role: FOLLOWER
I20260811 01:37:32.490593 19872 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } }
I20260811 01:37:32.490806 19872 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:32.490904 19872 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:32.491037 19872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:32.493175 19872 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } }
I20260811 01:37:32.493639 19872 leader_election.cc:302] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaae36c9b0144c298f01f470c59066f7; no voters:
I20260811 01:37:32.494320 19872 leader_election.cc:288] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:32.494506 19877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:32.495441 19877 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [term 1 LEADER]: Becoming Leader. State: Replica: aaae36c9b0144c298f01f470c59066f7, State: Running, Role: LEADER
I20260811 01:37:32.495968 19877 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } }
I20260811 01:37:32.496570 19872 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:32.499049 19879 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaae36c9b0144c298f01f470c59066f7. Latest consensus state: current_term: 1 leader_uuid: "aaae36c9b0144c298f01f470c59066f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } } }
I20260811 01:37:32.499178 19878 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaae36c9b0144c298f01f470c59066f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaae36c9b0144c298f01f470c59066f7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44731 } } }
I20260811 01:37:32.499706 19879 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:32.499734 19878 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:32.501565 19885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:32.507148 19885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:32.516898 19885 catalog_manager.cc:1347] Generated new cluster ID: 9b9b5b5bee29419d8443ac1abbe05819
I20260811 01:37:32.517035 19885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:32.533588 19885 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:32.535655 19885 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:32.550659 19885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Generated new TSK 0
I20260811 01:37:32.551641 19885 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:32.617897 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44731
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:43065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:32.989112 19899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:32.989403 19899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:32.989579 19899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:32.997234 19899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:32.997376 19899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:32.997529 19899 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:37:32.997614 19899 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:32.997746 19899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:33.008374 19899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:44731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:33.009730 19899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:33.011209 19899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:33.024988 19905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:33.024951 19908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:33.024884 19906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:33.025980 19899 server_base.cc:1034] running on GCE node
I20260811 01:37:33.026604 19899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:33.027561 19899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:33.028802 19899 hybrid_clock.cc:648] HybridClock initialized: now 1786412253028750 us; error 47 us; skew 500 ppm
I20260811 01:37:33.029155 19899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:33 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412253, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:33.037999 19899 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:33.039733 19899 webserver.cc:460] Webserver started at http://127.17.132.1:45325/ using document root <none> and password file <none>
I20260811 01:37:33.040475 19899 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:33.040594 19899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:33.040874 19899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:33.044011 19899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "6d21046ecd274a65887d004116c2ca1b"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "1739216db86bc831c472000951ece366"
server_key_iv: "40c8a9433ea456cf69e1c36ea1e81cf6"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.044768 19899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "6d21046ecd274a65887d004116c2ca1b"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "1739216db86bc831c472000951ece366"
server_key_iv: "40c8a9433ea456cf69e1c36ea1e81cf6"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.050522 19899 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260811 01:37:33.054432 19915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:33.055879 19899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:37:33.056023 19899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "6d21046ecd274a65887d004116c2ca1b"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "1739216db86bc831c472000951ece366"
server_key_iv: "40c8a9433ea456cf69e1c36ea1e81cf6"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.056200 19899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:33.078890 19899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:33.083678 19899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:33.083938 19899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:33.086984 19899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:33.087137 19899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:33.087330 19899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:33.087443 19899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:33 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412253, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:33.113240 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.087549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:49281 (local address 127.17.132.62:44731)
0811 01:37:33.088623 (+ 1074us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:33.088633 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:33.089252 (+ 619us) server_negotiation.cc:407] Connection header received
0811 01:37:33.091561 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:33.091568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:33.091673 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:33.091807 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:33.094414 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.095546 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.098645 (+ 3099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.099193 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.099356 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.103900 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:33.103909 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:33.103915 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:33.103995 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:33.108217 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.109488 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.109498 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.109510 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.109671 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.110366 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.110375 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.110381 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.110824 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:33.111011 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:33.112410 (+ 1399us) server_negotiation.cc:299] Negotiation successful
0811 01:37:33.112719 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":889,"thread_start_us":794,"threads_started":1}
I20260811 01:37:33.115139 19925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.088169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.1:49281)
0811 01:37:33.089080 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:33.089120 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:33.091240 (+ 2120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:33.092077 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:33.092087 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:33.092983 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:33.094187 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.094219 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.095726 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.095732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.098442 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.098460 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.099482 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.099493 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.099810 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.100680 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:33.100711 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:33.103590 (+ 2879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:33.108453 (+ 4863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.108478 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.108505 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.109326 (+ 821us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.109851 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.109863 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.109867 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.110180 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.111113 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:33.111124 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:33.111791 (+ 667us) client_negotiation.cc:769] Sending connection context
0811 01:37:33.112220 (+ 429us) client_negotiation.cc:240] Negotiation successful
0811 01:37:33.113018 (+ 798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":414,"threads_started":1}
I20260811 01:37:33.140715 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.122744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.1:42693)
0811 01:37:33.123863 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:33.123895 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:33.124075 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:33.124578 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:33.124581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:33.125033 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:33.125330 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.125339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.126687 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.126699 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.127992 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.128007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.129314 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.129326 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.129666 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.130626 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:33.130644 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:33.132240 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:33.136575 (+ 4335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.136580 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.136583 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.137334 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.137929 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.137935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.137941 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.138148 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.139033 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:33.139041 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:33.139323 (+ 282us) client_negotiation.cc:769] Sending connection context
0811 01:37:33.139515 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 01:37:33.140014 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":819,"threads_started":1}
I20260811 01:37:33.141597 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.122347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:42693 (local address 127.17.132.62:44731)
0811 01:37:33.122549 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:33.122566 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:33.124026 (+ 1460us) server_negotiation.cc:407] Connection header received
0811 01:37:33.124275 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:33.124280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:33.124346 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:33.124402 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:33.125493 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.126513 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.128150 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.128961 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.129137 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.132552 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:33.132573 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:33.132581 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:33.132635 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:33.136364 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.137522 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.137529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.137533 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.137731 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.138298 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.138303 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.138306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.138769 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:33.138934 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:33.141103 (+ 2169us) server_negotiation.cc:299] Negotiation successful
0811 01:37:33.141294 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:37:33.143544 19899 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:44293
I20260811 01:37:33.143570 20045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:44293 every 8 connection(s)
I20260811 01:37:33.145437 19899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:33.147787 20046 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44731
I20260811 01:37:33.148036 20046 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:33.148689 20046 heartbeater.cc:511] Master 127.17.132.62:44731 requested a full tablet report, sending...
I20260811 01:37:33.150709 19821 ts_manager.cc:194] Registered new tserver with Master: 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293)
I20260811 01:37:33.152166 19821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:49281
I20260811 01:37:33.155153 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 19899
I20260811 01:37:33.155345 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:33.156003 17936 external_mini_cluster.cc:1428] Setting key 3d130b479241e21bee582a237bc6c94c
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:33.205555 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44731
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:43065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:33.552263 20050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:33.552627 20050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:33.552819 20050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:33.560761 20050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:33.560937 20050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:33.561100 20050 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:37:33.561213 20050 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:33.561342 20050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:33.572242 20050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:44731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:33.573871 20050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:33.575788 20050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:33.590884 20058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:33.590849 20056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:33.590934 20055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:33.595868 20050 server_base.cc:1034] running on GCE node
I20260811 01:37:33.596760 20050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:33.598181 20050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:33.599493 20050 hybrid_clock.cc:648] HybridClock initialized: now 1786412253599432 us; error 40 us; skew 500 ppm
I20260811 01:37:33.599922 20050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:33 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412253, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:33.603461 20050 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:33.605365 20050 webserver.cc:460] Webserver started at http://127.17.132.2:41557/ using document root <none> and password file <none>
I20260811 01:37:33.606225 20050 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:33.606364 20050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:33.606715 20050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:33.609891 20050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "99d1765587a74bcd917069c2cd814907"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "2566c1d72fb30c09565c8530a8b41d68"
server_key_iv: "01eee16fa452a42c7547ff09c336c629"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.610723 20050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "99d1765587a74bcd917069c2cd814907"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "2566c1d72fb30c09565c8530a8b41d68"
server_key_iv: "01eee16fa452a42c7547ff09c336c629"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.616648 20050 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260811 01:37:33.620739 20065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:33.622364 20050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:33.622515 20050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "99d1765587a74bcd917069c2cd814907"
format_stamp: "Formatted at 2026-08-11 01:37:33 on dist-test-slave-0kls"
server_key: "2566c1d72fb30c09565c8530a8b41d68"
server_key_iv: "01eee16fa452a42c7547ff09c336c629"
server_key_version: "encryptionkey@0"
I20260811 01:37:33.622697 20050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:33.656378 20050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:33.661024 20050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:33.661281 20050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:33.664273 20050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:33.664440 20050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:33.664584 20050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:33.664682 20050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:33 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412253, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:33.693161 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.665307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:44173 (local address 127.17.132.62:44731)
0811 01:37:33.665815 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:33.665822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:33.667267 (+ 1445us) server_negotiation.cc:407] Connection header received
0811 01:37:33.670708 (+ 3441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:33.670714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:33.670805 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:33.670921 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:33.673708 (+ 2787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.674952 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.678221 (+ 3269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.678825 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.678935 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.685370 (+ 6435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:33.685380 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:33.685388 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:33.685452 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:33.689214 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.690543 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.690549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.690553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.690704 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.691202 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.691208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.691212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.691531 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:33.691709 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:33.692517 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 01:37:33.692766 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":244,"threads_started":1}
I20260811 01:37:33.694572 20077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.666132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.2:44173)
0811 01:37:33.667061 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:33.667114 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:33.670265 (+ 3151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:33.671273 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:33.671290 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:33.672320 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:33.673393 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.673426 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.675197 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.675202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.677917 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.677936 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.679125 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.679136 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.679622 (+ 486us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.680729 (+ 1107us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:33.680778 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:33.685041 (+ 4263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:33.689413 (+ 4372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.689424 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.689448 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.690329 (+ 881us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.690832 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.690837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.690840 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.691067 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.691675 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:33.691685 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:33.692103 (+ 418us) client_negotiation.cc:769] Sending connection context
0811 01:37:33.692408 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 01:37:33.693008 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":369,"threads_started":1}
I20260811 01:37:33.720657 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.702741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:43685 (local address 127.17.132.62:44731)
0811 01:37:33.703014 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:33.703024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:33.703968 (+ 944us) server_negotiation.cc:407] Connection header received
0811 01:37:33.704164 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:33.704170 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:33.704327 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:33.704694 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:33.706611 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.707626 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.710445 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.711277 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.711435 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.713686 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:33.713697 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:33.713705 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:33.713770 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:33.717698 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.718498 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.718504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.718508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.718684 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:33.719075 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:33.719081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:33.719085 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:33.719441 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:33.719602 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:33.720025 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 01:37:33.720294 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:37:33.720765 20145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:33.702827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.2:43685)
0811 01:37:33.703674 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:33.703700 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:33.703938 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:33.704734 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:33.704742 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:33.705629 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:33.706334 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.706358 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.707775 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.707784 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.710156 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:33.710180 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:33.711578 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:33.711586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:33.711723 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:33.712527 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:33.712547 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:33.713402 (+ 855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:33.717884 (+ 4482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.717893 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.717898 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.718346 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.718794 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:33.718799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:33.718803 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:33.718945 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:33.719565 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:33.719570 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:33.719773 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 01:37:33.719928 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 01:37:33.720296 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":417,"threads_started":1}
I20260811 01:37:33.731703 20050 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:43327
I20260811 01:37:33.731796 20194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:43327 every 8 connection(s)
I20260811 01:37:33.733089 20050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:33.735572 20195 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44731
I20260811 01:37:33.735859 20195 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:33.736609 20195 heartbeater.cc:511] Master 127.17.132.62:44731 requested a full tablet report, sending...
I20260811 01:37:33.738286 19821 ts_manager.cc:194] Registered new tserver with Master: 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327)
I20260811 01:37:33.739125 19821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:44173
I20260811 01:37:33.739902 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20050
I20260811 01:37:33.740093 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:33.740669 17936 external_mini_cluster.cc:1428] Setting key 0f4cebfd059926237c76af1a829e3742
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:33.789968 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44731
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:43065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:34.146634 20199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:34.147015 20199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:34.147204 20199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 01:37:34.155130 20046 heartbeater.cc:503] Master 127.17.132.62:44731 was elected leader, sending a full tablet report...
W20260811 01:37:34.156090 20199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:34.156240 20199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:34.156385 20199 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:37:34.156471 20199 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:37:34.156579 20199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:34.167685 20199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:44731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:34.169088 20199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:34.170567 20199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:34.184337 20204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:34.184297 20205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:34.184399 20208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:34.185551 20199 server_base.cc:1034] running on GCE node
I20260811 01:37:34.186314 20199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:34.187263 20199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:34.188516 20199 hybrid_clock.cc:648] HybridClock initialized: now 1786412254188442 us; error 54 us; skew 500 ppm
I20260811 01:37:34.188889 20199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:34 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412254, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:34.192413 20199 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:34.194108 20199 webserver.cc:460] Webserver started at http://127.17.132.3:43015/ using document root <none> and password file <none>
I20260811 01:37:34.194872 20199 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:34.195024 20199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:34.195403 20199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:34.199036 20199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "6ebffd0c7339431c858eb513851a441b"
format_stamp: "Formatted at 2026-08-11 01:37:34 on dist-test-slave-0kls"
server_key: "c1158b66cf56ffbfbf41ca877c015148"
server_key_iv: "805ac4473680d7a4a71823f3c84fb762"
server_key_version: "encryptionkey@0"
I20260811 01:37:34.199971 20199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "6ebffd0c7339431c858eb513851a441b"
format_stamp: "Formatted at 2026-08-11 01:37:34 on dist-test-slave-0kls"
server_key: "c1158b66cf56ffbfbf41ca877c015148"
server_key_iv: "805ac4473680d7a4a71823f3c84fb762"
server_key_version: "encryptionkey@0"
I20260811 01:37:34.206030 20199 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 01:37:34.209898 20216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:34.211380 20199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:34.211568 20199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "6ebffd0c7339431c858eb513851a441b"
format_stamp: "Formatted at 2026-08-11 01:37:34 on dist-test-slave-0kls"
server_key: "c1158b66cf56ffbfbf41ca877c015148"
server_key_iv: "805ac4473680d7a4a71823f3c84fb762"
server_key_version: "encryptionkey@0"
I20260811 01:37:34.211788 20199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:34.234521 20199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:34.239406 20199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:34.239770 20199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:34.243007 20199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:34.243139 20199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:34.243281 20199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:34.243381 20199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:37:34 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412254, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:34.267184 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.243640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:55735 (local address 127.17.132.62:44731)
0811 01:37:34.244350 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.244355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.245377 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 01:37:34.247550 (+ 2173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.247556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.247654 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.247791 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:34.250201 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.251394 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.253570 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.254117 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.254263 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.259404 (+ 5141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:34.259410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:34.259413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:34.259450 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:34.263549 (+ 4099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.264456 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.264462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.264465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.264615 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.265124 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.265129 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.265134 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.265429 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:34.265596 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.266495 (+ 899us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.266762 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":482,"threads_started":1}
I20260811 01:37:34.268567 20226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.244273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.3:55735)
0811 01:37:34.245201 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.245252 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.247234 (+ 1982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.248056 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.248065 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.248910 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:34.249973 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.250012 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.251578 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.251589 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.253402 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.253417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.254408 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.254417 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.254819 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.255784 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:34.255834 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:34.259103 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:34.263743 (+ 4640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.263755 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.263777 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.264298 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.264750 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.264756 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.264760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.264990 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.265576 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:34.265585 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:34.266091 (+ 506us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.266397 (+ 306us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.266999 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":438,"threads_started":1}
I20260811 01:37:34.295802 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.277411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:56315 (local address 127.17.132.62:44731)
0811 01:37:34.277578 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.277583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.278031 (+ 448us) server_negotiation.cc:407] Connection header received
0811 01:37:34.278327 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.278336 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.278433 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.278523 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:34.280619 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.281647 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.284434 (+ 2787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.284878 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.284983 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.287868 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:34.287876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:34.287880 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:34.287927 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:34.291802 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.293019 (+ 1217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.293024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.293026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.293183 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.293913 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.293922 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.293927 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.294414 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:34.294604 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.295326 (+ 722us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.295545 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:37:34.296439 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.276861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.17.132.3:56315)
0811 01:37:34.277872 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.277902 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.278103 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.278830 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.278837 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.279743 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:34.280338 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.280359 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.281884 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.281892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.284257 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.284278 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.285105 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.285114 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.285358 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.286255 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:34.286278 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:34.287570 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:34.291992 (+ 4422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.292002 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.292009 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.292783 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.293376 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.293387 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.293394 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.293627 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.294592 (+ 965us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:34.294601 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:34.294902 (+ 301us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.295160 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.295689 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"thread_start_us":718,"threads_started":1}
I20260811 01:37:34.299522 20199 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:35903
I20260811 01:37:34.299542 20350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:35903 every 8 connection(s)
I20260811 01:37:34.301009 20199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:34.303632 20351 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44731
I20260811 01:37:34.303918 20351 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:34.304580 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20199
I20260811 01:37:34.304824 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:34.304962 20351 heartbeater.cc:511] Master 127.17.132.62:44731 requested a full tablet report, sending...
I20260811 01:37:34.305430 17936 external_mini_cluster.cc:1428] Setting key eb3fa14ce57cd595956be0ad562b7b62
I20260811 01:37:34.306811 19821 ts_manager.cc:194] Registered new tserver with Master: 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:34.307991 19821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:55735
I20260811 01:37:34.309197 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:37:34 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:37:34 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:34.367249 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.353068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.17.132.62:44731)
0811 01:37:34.353372 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.353377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.353597 (+ 220us) server_negotiation.cc:407] Connection header received
0811 01:37:34.353773 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.353777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.354005 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.354102 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:34.355524 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.356271 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.357484 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.357915 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.358010 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.362183 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:34.362188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:34.362191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:34.362225 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:34.364647 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.365267 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.365270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.365273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.365407 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.365723 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.365726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.365728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.366217 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:34.366418 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.366653 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.366820 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:37:34.372102 19820 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:34.379634 19820 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:34.405829 20364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.392299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:43327 (local address 127.0.0.1:56814)
0811 01:37:34.393129 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.393173 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.393370 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.394920 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.394931 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.394974 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:34.395546 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.395563 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.398513 (+ 2950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.398523 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.401932 (+ 3409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.401963 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.404728 (+ 2765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.404735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.404994 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.405064 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.405193 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.405416 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":425,"threads_started":1}
I20260811 01:37:34.406872 20365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.392491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56814 (local address 127.17.132.2:43327)
0811 01:37:34.394090 (+ 1599us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.394113 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.394149 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:37:34.394273 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.394284 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.394602 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.395816 (+ 1214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:34.396142 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.398272 (+ 2130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.402284 (+ 4012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.404428 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.406001 (+ 1573us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.406260 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.406341 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.406544 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1378,"thread_start_us":1190,"threads_started":1}
I20260811 01:37:34.411664 20123 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab93f6a467f476b8c3aab822473a36f (DEFAULT_TABLE table=test-table [id=df9ae98c429e4a7385ece0ba27db9633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:34.413164 20364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.393630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:44293 (local address 127.0.0.1:37854)
0811 01:37:34.406115 (+ 12485us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.406134 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.406239 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.406954 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.406959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.406988 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:34.407189 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.407207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.409060 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.409065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.410509 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.410523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.412263 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.412269 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.412482 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.412520 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.412588 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.412744 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12370,"mutex_wait_us":3,"thread_start_us":13785,"threads_started":1}
I20260811 01:37:34.413259 20123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab93f6a467f476b8c3aab822473a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.414217 20369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.394223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37854 (local address 127.17.132.1:44293)
0811 01:37:34.405835 (+ 11612us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.405846 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.406382 (+ 536us) server_negotiation.cc:407] Connection header received
0811 01:37:34.406496 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.406503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.406723 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.407400 (+ 677us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:34.407650 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.408858 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.410691 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.412046 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.413433 (+ 1387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.413667 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.413751 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.413970 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9857,"thread_start_us":9707,"threads_started":1}
I20260811 01:37:34.416963 20366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.392824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.0.0.1:38784)
0811 01:37:34.404735 (+ 11911us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.404763 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.404964 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.406773 (+ 1809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.406781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.406820 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:34.408953 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.408973 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.411252 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.411257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.413843 (+ 2586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.413857 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.415998 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.416005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.416219 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.416253 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.416357 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.416563 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11723,"mutex_wait_us":65,"thread_start_us":11537,"threads_started":1}
I20260811 01:37:34.417819 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.393128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38784 (local address 127.17.132.3:35903)
0811 01:37:34.403921 (+ 10793us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.403935 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.405155 (+ 1220us) server_negotiation.cc:407] Connection header received
0811 01:37:34.405304 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.405316 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.405706 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.406341 (+ 635us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:34.409224 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.411099 (+ 1875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.414017 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.415753 (+ 1736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.415890 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.416153 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.416464 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.417460 (+ 996us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10528,"thread_start_us":10821,"threads_started":1}
I20260811 01:37:34.418251 19970 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab93f6a467f476b8c3aab822473a36f (DEFAULT_TABLE table=test-table [id=df9ae98c429e4a7385ece0ba27db9633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:34.419945 19970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab93f6a467f476b8c3aab822473a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.423695 20273 tablet_service.cc:1467] Processing CreateTablet for tablet 8ab93f6a467f476b8c3aab822473a36f (DEFAULT_TABLE table=test-table [id=df9ae98c429e4a7385ece0ba27db9633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:34.425437 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ab93f6a467f476b8c3aab822473a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.433275 20370 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Bootstrap starting.
I20260811 01:37:34.435420 20371 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Bootstrap starting.
I20260811 01:37:34.437968 20370 tablet_bootstrap.cc:654] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.439119 20370 log.cc:824] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:34.439314 20371 tablet_bootstrap.cc:654] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.440610 20371 log.cc:824] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:34.442477 20370 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: No bootstrap required, opened a new log
I20260811 01:37:34.442826 20370 ts_tablet_manager.cc:1397] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 01:37:34.443424 20375 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Bootstrap starting.
I20260811 01:37:34.443904 20371 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: No bootstrap required, opened a new log
I20260811 01:37:34.444183 20371 ts_tablet_manager.cc:1397] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 01:37:34.447618 20375 tablet_bootstrap.cc:654] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.448985 20375 log.cc:824] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:34.453373 20375 tablet_bootstrap.cc:492] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: No bootstrap required, opened a new log
I20260811 01:37:34.453775 20375 ts_tablet_manager.cc:1397] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:37:34.453697 20371 raft_consensus.cc:348] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.454241 20371 raft_consensus.cc:374] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.454360 20371 raft_consensus.cc:729] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.454100 20370 raft_consensus.cc:348] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.454526 20370 raft_consensus.cc:374] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.454654 20370 raft_consensus.cc:729] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.455237 20371 consensus_queue.cc:260] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.455348 20370 consensus_queue.cc:260] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.463547 20370 ts_tablet_manager.cc:1428] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Time spent starting tablet: real 0.021s user 0.019s sys 0.001s
I20260811 01:37:34.463570 20371 ts_tablet_manager.cc:1428] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Time spent starting tablet: real 0.019s user 0.015s sys 0.004s
I20260811 01:37:34.463955 20195 heartbeater.cc:503] Master 127.17.132.62:44731 was elected leader, sending a full tablet report...
I20260811 01:37:34.468585 20375 raft_consensus.cc:348] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.469269 20375 raft_consensus.cc:374] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.469439 20375 raft_consensus.cc:729] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.471465 20375 consensus_queue.cc:260] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.472707 20351 heartbeater.cc:503] Master 127.17.132.62:44731 was elected leader, sending a full tablet report...
I20260811 01:37:34.473394 20375 ts_tablet_manager.cc:1428] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Time spent starting tablet: real 0.019s user 0.014s sys 0.000s
W20260811 01:37:34.485407 20196 tablet.cc:2369] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:37:34.552947 20352 tablet.cc:2369] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:34.624010 20378 raft_consensus.cc:482] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:34.624454 20378 raft_consensus.cc:504] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.626600 20378 leader_election.cc:288] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:34.633960 20369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.627144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:49811 (local address 127.17.132.1:44293)
0811 01:37:34.627519 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.627526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.628121 (+ 595us) server_negotiation.cc:407] Connection header received
0811 01:37:34.628379 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.628390 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.628451 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.628551 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:34.629150 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.629960 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.631889 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.632836 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.632965 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.633020 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.633477 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.633653 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260811 01:37:34.634276 20380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.626862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:44293 (local address 127.17.132.2:49811)
0811 01:37:34.628003 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.628020 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.628229 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.628580 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.628584 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.628611 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:34.628997 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.629008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.630166 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.630171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.631703 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.631715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.633068 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.633076 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.633285 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.633334 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.633431 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.633583 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"mutex_wait_us":3,"thread_start_us":596,"threads_started":1}
I20260811 01:37:34.634289 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.627223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:53001 (local address 127.17.132.3:35903)
0811 01:37:34.627442 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.627449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.628417 (+ 968us) server_negotiation.cc:407] Connection header received
0811 01:37:34.628644 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.628648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.628706 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.628809 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:34.629478 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.630319 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.632312 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.633275 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.633455 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.633526 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.633894 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.634048 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:37:34.634449 20381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.627070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.17.132.2:53001)
0811 01:37:34.628213 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.628227 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.628475 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.628825 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.628829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.628858 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:34.629323 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.629334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.630471 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.630478 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.632145 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.632159 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.633522 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.633529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.633696 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.633735 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.633861 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.634008 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"mutex_wait_us":19,"thread_start_us":803,"threads_started":1}
I20260811 01:37:34.635634 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab93f6a467f476b8c3aab822473a36f" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b" is_pre_election: true
I20260811 01:37:34.636008 20299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab93f6a467f476b8c3aab822473a36f" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b" is_pre_election: true
I20260811 01:37:34.636188 19999 raft_consensus.cc:2454] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:34.636541 20299 raft_consensus.cc:2454] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:34.637041 20066 leader_election.cc:302] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:34.637472 20378 raft_consensus.cc:2781] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:34.637622 20378 raft_consensus.cc:482] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:34.637739 20378 raft_consensus.cc:3037] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:34.640043 20378 raft_consensus.cc:504] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.640751 20378 leader_election.cc:288] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Requested vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:34.641287 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab93f6a467f476b8c3aab822473a36f" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b"
I20260811 01:37:34.641321 20299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ab93f6a467f476b8c3aab822473a36f" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b"
I20260811 01:37:34.641538 19999 raft_consensus.cc:3037] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:34.641582 20299 raft_consensus.cc:3037] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:34.643929 19999 raft_consensus.cc:2454] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:34.643942 20299 raft_consensus.cc:2454] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:34.644471 20066 leader_election.cc:302] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 6ebffd0c7339431c858eb513851a441b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:34.644868 20378 raft_consensus.cc:2781] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:34.645495 20378 raft_consensus.cc:686] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Becoming Leader. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Running, Role: LEADER
I20260811 01:37:34.646168 20378 consensus_queue.cc:237] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
W20260811 01:37:34.648527 20047 tablet.cc:2369] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:34.651463 19820 catalog_manager.cc:5495] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99d1765587a74bcd917069c2cd814907 (127.17.132.2). New cstate: current_term: 1 leader_uuid: "99d1765587a74bcd917069c2cd814907" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:37:34 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412252, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:34.744292 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.728597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44731 (local address 127.0.0.1:52016)
0811 01:37:34.729289 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:34.729310 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:34.729510 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:34.729902 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:34.729906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:34.730695 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:34.731070 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.731086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.732220 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.732226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.733810 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:34.733829 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.734681 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.734688 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:34.734868 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.735670 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:34.735694 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:34.738555 (+ 2861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:34.741776 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.741828 (+ 52us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.741839 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.742269 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.742708 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:34.742711 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:34.742713 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:34.742852 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:34.743471 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:34.743477 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:34.743630 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 01:37:34.743760 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:37:34.743972 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":404,"threads_started":1}
I20260811 01:37:34.744580 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:34.728582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52016 (local address 127.17.132.62:44731)
0811 01:37:34.728826 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:34.728864 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:34.729421 (+ 557us) server_negotiation.cc:407] Connection header received
0811 01:37:34.729682 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:34.729686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:34.729743 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:34.729881 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:34.731281 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.732030 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.733981 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:34.734468 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:34.734590 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:34.738781 (+ 4191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:34.738786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:34.738789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:34.738823 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:34.741539 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.742396 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.742403 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.742406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.742581 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:34.742973 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:34.742978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:34.742981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:34.743334 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:34.743489 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:34.743908 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 01:37:34.744138 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 01:37:34.749460 19820 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:52016:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:37:34.750437 19820 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:34.757501 20123 tablet_service.cc:1467] Processing CreateTablet for tablet eb3e4a554f8b47d4a69d31ad67d71b3e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d138f4062ba342d5a8d543322ef76480]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:34.757395 19970 tablet_service.cc:1467] Processing CreateTablet for tablet eb3e4a554f8b47d4a69d31ad67d71b3e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d138f4062ba342d5a8d543322ef76480]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:34.757861 20273 tablet_service.cc:1467] Processing CreateTablet for tablet eb3e4a554f8b47d4a69d31ad67d71b3e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d138f4062ba342d5a8d543322ef76480]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:37:34.758502 20123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb3e4a554f8b47d4a69d31ad67d71b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.758498 19970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb3e4a554f8b47d4a69d31ad67d71b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.758657 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb3e4a554f8b47d4a69d31ad67d71b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:34.764110 20370 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: Bootstrap starting.
I20260811 01:37:34.765723 20370 tablet_bootstrap.cc:654] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.766057 20375 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: Bootstrap starting.
I20260811 01:37:34.766439 20371 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: Bootstrap starting.
I20260811 01:37:34.767928 20375 tablet_bootstrap.cc:654] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.768194 20371 tablet_bootstrap.cc:654] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:34.768507 20370 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: No bootstrap required, opened a new log
I20260811 01:37:34.768662 20370 ts_tablet_manager.cc:1397] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 01:37:34.769593 20370 raft_consensus.cc:348] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.769892 20370 raft_consensus.cc:374] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.769996 20370 raft_consensus.cc:729] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.770298 20375 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: No bootstrap required, opened a new log
I20260811 01:37:34.770267 20370 consensus_queue.cc:260] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.770447 20375 ts_tablet_manager.cc:1397] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:37:34.770761 20378 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:34.771034 20378 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:34.771304 20375 raft_consensus.cc:348] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.771513 20375 raft_consensus.cc:374] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.771612 20375 raft_consensus.cc:729] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.771855 20375 consensus_queue.cc:260] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.772414 20375 ts_tablet_manager.cc:1428] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:37:34.772857 20379 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:34.773188 20379 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:34.774080 20370 ts_tablet_manager.cc:1428] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260811 01:37:34.775146 20371 tablet_bootstrap.cc:492] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: No bootstrap required, opened a new log
I20260811 01:37:34.775308 20371 ts_tablet_manager.cc:1397] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260811 01:37:34.776315 20371 raft_consensus.cc:348] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.776604 20371 raft_consensus.cc:374] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:34.776724 20371 raft_consensus.cc:729] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Initialized, Role: FOLLOWER
I20260811 01:37:34.776975 20371 consensus_queue.cc:260] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:34.777601 20371 ts_tablet_manager.cc:1428] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:37:34.777477 20377 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:34.777956 20377 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:35.096047 20379 raft_consensus.cc:482] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:35.096364 20379 raft_consensus.cc:504] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.098120 20379 leader_election.cc:288] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327)
I20260811 01:37:35.103880 20378 consensus_queue.cc:1035] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.106388 20369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.098594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:46217 (local address 127.17.132.1:44293)
0811 01:37:35.098857 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.098863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.099059 (+ 196us) server_negotiation.cc:407] Connection header received
0811 01:37:35.099377 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.099386 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.099487 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.099591 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:35.100292 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.101412 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.104115 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.105266 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.105455 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.105535 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.105930 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.106087 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:37:35.106623 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.099138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:43327 (local address 127.17.132.3:59189)
0811 01:37:35.099724 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:35.099745 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:35.099882 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:35.100326 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:35.100329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:35.100350 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:35.100609 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.100617 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.102007 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.102012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.104004 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.104017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.105715 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.105720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.105954 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.105985 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:37:35.106066 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:37:35.106219 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":22,"thread_start_us":257,"threads_started":1}
I20260811 01:37:35.106899 20396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.099400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:59189 (local address 127.17.132.2:43327)
0811 01:37:35.100018 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.100022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.100039 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:37:35.100099 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.100103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.100166 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.100296 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:35.100781 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.101852 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.104189 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.105303 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.105482 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.105558 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.106355 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.106519 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":394,"threads_started":1}
I20260811 01:37:35.107414 20394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.098457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:44293 (local address 127.17.132.3:46217)
0811 01:37:35.098937 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:35.098953 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:35.099171 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:35.099882 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:35.099888 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:35.099920 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:35.100130 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.100138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.101565 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.101570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.103950 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.103969 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.105464 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.105471 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.105674 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.105719 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:37:35.106882 (+ 1163us) client_negotiation.cc:240] Negotiation successful
0811 01:37:35.107143 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":53,"thread_start_us":271,"threads_started":1}
I20260811 01:37:35.107883 20150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb3e4a554f8b47d4a69d31ad67d71b3e" candidate_uuid: "6ebffd0c7339431c858eb513851a441b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99d1765587a74bcd917069c2cd814907" is_pre_election: true
I20260811 01:37:35.108366 20150 raft_consensus.cc:2454] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ebffd0c7339431c858eb513851a441b in term 0.
I20260811 01:37:35.108321 19997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb3e4a554f8b47d4a69d31ad67d71b3e" candidate_uuid: "6ebffd0c7339431c858eb513851a441b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b" is_pre_election: true
I20260811 01:37:35.108740 19997 raft_consensus.cc:2454] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ebffd0c7339431c858eb513851a441b in term 0.
I20260811 01:37:35.109068 20217 leader_election.cc:302] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ebffd0c7339431c858eb513851a441b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:35.109999 20379 raft_consensus.cc:2781] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:35.110149 20379 raft_consensus.cc:482] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:35.110287 20379 raft_consensus.cc:3037] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.113530 20379 raft_consensus.cc:504] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.114908 20379 leader_election.cc:288] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [CANDIDATE]: Term 1 election: Requested vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327)
I20260811 01:37:35.115198 20150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb3e4a554f8b47d4a69d31ad67d71b3e" candidate_uuid: "6ebffd0c7339431c858eb513851a441b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99d1765587a74bcd917069c2cd814907"
I20260811 01:37:35.115360 20150 raft_consensus.cc:3037] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.116657 19997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb3e4a554f8b47d4a69d31ad67d71b3e" candidate_uuid: "6ebffd0c7339431c858eb513851a441b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b"
I20260811 01:37:35.116927 19997 raft_consensus.cc:3037] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.118328 20150 raft_consensus.cc:2454] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ebffd0c7339431c858eb513851a441b in term 1.
I20260811 01:37:35.118369 20382 consensus_queue.cc:1035] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.118856 20217 leader_election.cc:302] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ebffd0c7339431c858eb513851a441b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:35.119354 20379 raft_consensus.cc:2781] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:35.119506 20379 raft_consensus.cc:686] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [term 1 LEADER]: Becoming Leader. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Running, Role: LEADER
I20260811 01:37:35.120031 20379 consensus_queue.cc:237] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.121178 19997 raft_consensus.cc:2454] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ebffd0c7339431c858eb513851a441b in term 1.
I20260811 01:37:35.124980 20400 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: TxnStatusTablet state changed. Reason: New leader 6ebffd0c7339431c858eb513851a441b. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.125522 20400 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:35.125699 19818 catalog_manager.cc:5495] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ebffd0c7339431c858eb513851a441b (127.17.132.3). New cstate: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } health_report { overall_health: HEALTHY } } }
I20260811 01:37:35.129909 20404 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:37:35.130393 20404 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:37:35.157368 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.142746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.0.0.1:38796)
0811 01:37:35.143000 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:35.143021 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:35.143172 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:35.150565 (+ 7393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:35.150572 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:35.150589 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:35.150806 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.150817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.152548 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.152554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.154160 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.154178 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.155276 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.155282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.155471 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.155557 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.156763 (+ 1206us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.156788 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:37:35.156874 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:37:35.157042 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:37:35.157405 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.143455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38796 (local address 127.17.132.3:35903)
0811 01:37:35.149976 (+ 6521us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.149983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.150017 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:37:35.150137 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.150151 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.150268 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.150463 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:35.151019 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.152371 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.154349 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.155087 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.155233 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.155823 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.156631 (+ 808us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.156790 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.156919 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.157012 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6367,"thread_start_us":6197,"threads_started":1}
I20260811 01:37:35.166390 19999 raft_consensus.cc:1261] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Refusing update from remote peer 6ebffd0c7339431c858eb513851a441b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:35.166731 20150 raft_consensus.cc:1261] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Refusing update from remote peer 6ebffd0c7339431c858eb513851a441b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:35.167193 20400 consensus_queue.cc:1035] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.167595 20403 consensus_queue.cc:1035] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.173234 20377 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: TxnStatusTablet state changed. Reason: New leader 6ebffd0c7339431c858eb513851a441b. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.173559 20377 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:35.176976 20407 mvcc.cc:205] Tried to move back new op lower bound from 7317144597152362496 to 7317144596976033792. Current Snapshot: MvccSnapshot[applied={T|T < 7317144597152362496}]
I20260811 01:37:35.180811 20377 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.181110 20377 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6d21046ecd274a65887d004116c2ca1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:35.187033 20403 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.187426 20403 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:35.190542 20382 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: TxnStatusTablet state changed. Reason: New leader 6ebffd0c7339431c858eb513851a441b. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.190826 20382 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:35.192412 20403 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.192709 20403 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 6ebffd0c7339431c858eb513851a441b: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:37:35.194711 20398 mvcc.cc:205] Tried to move back new op lower bound from 7317144597152362496 to 7317144596976033792. Current Snapshot: MvccSnapshot[applied={T|T < 7317144597152362496}]
I20260811 01:37:35.195945 20382 tablet_replica.cc:439] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebffd0c7339431c858eb513851a441b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } } }
I20260811 01:37:35.196221 20382 tablet_replica.cc:442] T eb3e4a554f8b47d4a69d31ad67d71b3e P 99d1765587a74bcd917069c2cd814907: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:37:35.206624 20396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.199879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56822 (local address 127.17.132.2:43327)
0811 01:37:35.200091 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.200098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.200463 (+ 365us) server_negotiation.cc:407] Connection header received
0811 01:37:35.200667 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.200671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.200750 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.200869 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:35.201389 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.202178 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.204226 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.204655 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.204765 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.205316 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.205983 (+ 667us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.206103 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.206257 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.206335 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 01:37:35.224625 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.218183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.17.132.2:50133)
0811 01:37:35.218920 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:35.218952 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:35.219077 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:35.219437 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:35.219441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:35.219451 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:35.219711 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.219720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.221172 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.221177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.222379 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.222393 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.223420 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.223429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.223607 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.223688 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.224168 (+ 480us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.224178 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:37:35.224245 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:37:35.224344 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":432,"threads_started":1}
I20260811 01:37:35.224710 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.218220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:50133 (local address 127.17.132.3:35903)
0811 01:37:35.218437 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.218444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.219045 (+ 601us) server_negotiation.cc:407] Connection header received
0811 01:37:35.219207 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.219214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.219305 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.219399 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:35.219868 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.221031 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.222518 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.223207 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.223330 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.223921 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.224066 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.224168 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.224294 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.224380 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 01:37:35.281546 20396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.274171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:39977 (local address 127.17.132.2:43327)
0811 01:37:35.274403 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:35.274412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:35.275186 (+ 774us) server_negotiation.cc:407] Connection header received
0811 01:37:35.275404 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:35.275409 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:35.275499 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:35.275604 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:35.276263 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.277326 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.279522 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.279973 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.280079 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.280684 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.280848 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.280916 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:35.281171 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 01:37:35.281265 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:37:35.282362 20423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:35.274097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:43327 (local address 127.17.132.3:39977)
0811 01:37:35.275053 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:35.275073 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:35.275253 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:35.275644 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:35.275649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:35.275663 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:35.276051 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.276064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.277478 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.277485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.279354 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:35.279371 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:35.280139 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:35.280155 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:35.280347 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:35.280435 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:35.281007 (+ 572us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:35.281017 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:37:35.281753 (+ 736us) client_negotiation.cc:240] Negotiation successful
0811 01:37:35.281937 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":541,"threads_started":1}
I20260811 01:37:35.355963 19818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:35.356312 19818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:35.360843 19818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Sending DeleteTablet for 3 replicas of tablet 8ab93f6a467f476b8c3aab822473a36f
I20260811 01:37:35.362466 19970 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab93f6a467f476b8c3aab822473a36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:35 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:37854
I20260811 01:37:35.363371 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab93f6a467f476b8c3aab822473a36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:35 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:38784
I20260811 01:37:35.363365 20123 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ab93f6a467f476b8c3aab822473a36f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:35 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56814
I20260811 01:37:35.372040 19818 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 01:37:35.373057 20430 tablet_replica.cc:330] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: stopping tablet replica
W20260811 01:37:35.373435 19818 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:35.373586 20430 raft_consensus.cc:2229] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:35.374365 20430 raft_consensus.cc:2258] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:35.378281 20430 ts_tablet_manager.cc:1905] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:35.383610 19969 tablet_service.cc:1467] Processing CreateTablet for tablet b4055da69d214ee2b18dcc371a10182b (DEFAULT_TABLE table=test-table [id=c9d4517aad6d4e00866d02243b3af9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:35.384156 19969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4055da69d214ee2b18dcc371a10182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:35.384436 20123 tablet_service.cc:1467] Processing CreateTablet for tablet b4055da69d214ee2b18dcc371a10182b (DEFAULT_TABLE table=test-table [id=c9d4517aad6d4e00866d02243b3af9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:35.385102 20123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4055da69d214ee2b18dcc371a10182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:35.389067 20272 tablet_service.cc:1467] Processing CreateTablet for tablet b4055da69d214ee2b18dcc371a10182b (DEFAULT_TABLE table=test-table [id=c9d4517aad6d4e00866d02243b3af9c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:35.389717 20272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4055da69d214ee2b18dcc371a10182b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:35.402791 20428 tablet_replica.cc:330] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: stopping tablet replica
I20260811 01:37:35.404050 20428 raft_consensus.cc:2229] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:35.404366 20432 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Bootstrap starting.
I20260811 01:37:35.406951 20432 tablet_bootstrap.cc:654] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:35.407480 20428 raft_consensus.cc:2258] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:35.410135 20428 ts_tablet_manager.cc:1905] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:35.414969 20433 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Bootstrap starting.
I20260811 01:37:35.415410 20434 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Bootstrap starting.
I20260811 01:37:35.417209 20431 tablet_replica.cc:330] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: stopping tablet replica
I20260811 01:37:35.418881 20431 raft_consensus.cc:2229] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:35.419293 20431 raft_consensus.cc:2258] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:35.421205 20434 tablet_bootstrap.cc:654] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:35.425284 20433 tablet_bootstrap.cc:654] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:35.426429 20432 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: No bootstrap required, opened a new log
I20260811 01:37:35.426733 20432 ts_tablet_manager.cc:1397] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.007s
I20260811 01:37:35.427877 20431 ts_tablet_manager.cc:1905] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:35.427830 20432 raft_consensus.cc:348] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.428339 20432 raft_consensus.cc:374] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:35.428525 20432 raft_consensus.cc:729] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Initialized, Role: FOLLOWER
I20260811 01:37:35.428948 20432 consensus_queue.cc:260] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.432956 20432 ts_tablet_manager.cc:1428] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 01:37:35.436409 20428 ts_tablet_manager.cc:1918] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:35.436721 20428 log.cc:1196] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/8ab93f6a467f476b8c3aab822473a36f
I20260811 01:37:35.437383 20428 ts_tablet_manager.cc:1939] T 8ab93f6a467f476b8c3aab822473a36f P 6d21046ecd274a65887d004116c2ca1b: Deleting consensus metadata
I20260811 01:37:35.437522 20431 ts_tablet_manager.cc:1918] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:35.437703 20431 log.cc:1196] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/8ab93f6a467f476b8c3aab822473a36f
I20260811 01:37:35.438279 20431 ts_tablet_manager.cc:1939] T 8ab93f6a467f476b8c3aab822473a36f P 6ebffd0c7339431c858eb513851a441b: Deleting consensus metadata
I20260811 01:37:35.439811 19803 catalog_manager.cc:4841] TS 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293): tablet 8ab93f6a467f476b8c3aab822473a36f (table test-table [id=df9ae98c429e4a7385ece0ba27db9633]) successfully deleted
I20260811 01:37:35.442267 20434 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: No bootstrap required, opened a new log
I20260811 01:37:35.442445 20434 ts_tablet_manager.cc:1397] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.003s
I20260811 01:37:35.443450 20434 raft_consensus.cc:348] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.443722 20434 raft_consensus.cc:374] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:35.443833 20434 raft_consensus.cc:729] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Initialized, Role: FOLLOWER
I20260811 01:37:35.444101 20434 consensus_queue.cc:260] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.444897 20434 ts_tablet_manager.cc:1428] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:37:35.446421 20433 tablet_bootstrap.cc:492] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: No bootstrap required, opened a new log
I20260811 01:37:35.446568 20433 ts_tablet_manager.cc:1397] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260811 01:37:35.447391 20430 ts_tablet_manager.cc:1918] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:35.447396 20433 raft_consensus.cc:348] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.447606 20430 log.cc:1196] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/8ab93f6a467f476b8c3aab822473a36f
I20260811 01:37:35.447651 20433 raft_consensus.cc:374] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:35.447748 20433 raft_consensus.cc:729] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Initialized, Role: FOLLOWER
I20260811 01:37:35.448045 20433 consensus_queue.cc:260] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.448266 20430 ts_tablet_manager.cc:1939] T 8ab93f6a467f476b8c3aab822473a36f P 99d1765587a74bcd917069c2cd814907: Deleting consensus metadata
I20260811 01:37:35.450330 19803 catalog_manager.cc:4841] TS 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327): tablet 8ab93f6a467f476b8c3aab822473a36f (table test-table [id=df9ae98c429e4a7385ece0ba27db9633]) successfully deleted
I20260811 01:37:35.455272 20433 ts_tablet_manager.cc:1428] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260811 01:37:35.456996 19807 catalog_manager.cc:4841] TS 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903): tablet 8ab93f6a467f476b8c3aab822473a36f (table test-table [id=df9ae98c429e4a7385ece0ba27db9633]) successfully deleted
I20260811 01:37:35.536136 20382 raft_consensus.cc:482] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:35.536439 20382 raft_consensus.cc:504] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.537329 20382 leader_election.cc:288] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:35.538020 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4055da69d214ee2b18dcc371a10182b" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b" is_pre_election: true
I20260811 01:37:35.538210 20299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4055da69d214ee2b18dcc371a10182b" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b" is_pre_election: true
I20260811 01:37:35.538302 19999 raft_consensus.cc:2454] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:35.538509 20299 raft_consensus.cc:2454] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:35.538833 20066 leader_election.cc:302] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:35.539348 20382 raft_consensus.cc:2781] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:35.539476 20382 raft_consensus.cc:482] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:35.539600 20382 raft_consensus.cc:3037] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.543032 20382 raft_consensus.cc:504] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.543848 20382 leader_election.cc:288] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Requested vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:35.544487 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4055da69d214ee2b18dcc371a10182b" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b"
I20260811 01:37:35.544591 20299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4055da69d214ee2b18dcc371a10182b" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b"
I20260811 01:37:35.544730 19999 raft_consensus.cc:3037] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.544867 20299 raft_consensus.cc:3037] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:35.547962 19999 raft_consensus.cc:2454] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:35.548179 20299 raft_consensus.cc:2454] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:35.548637 20066 leader_election.cc:302] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:35.549106 20382 raft_consensus.cc:2781] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:35.549388 20382 raft_consensus.cc:686] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Becoming Leader. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Running, Role: LEADER
I20260811 01:37:35.549672 20382 consensus_queue.cc:237] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:35.552968 19820 catalog_manager.cc:5495] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99d1765587a74bcd917069c2cd814907 (127.17.132.2). New cstate: current_term: 1 leader_uuid: "99d1765587a74bcd917069c2cd814907" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } health_report { overall_health: UNKNOWN } } }
I20260811 01:37:35.590377 19997 raft_consensus.cc:1261] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Refusing update from remote peer 99d1765587a74bcd917069c2cd814907: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:35.590377 20299 raft_consensus.cc:1261] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Refusing update from remote peer 99d1765587a74bcd917069c2cd814907: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:35.591085 20421 consensus_queue.cc:1035] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.591770 20426 consensus_queue.cc:1035] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:35.600320 20399 mvcc.cc:205] Tried to move back new op lower bound from 7317144598886969344 to 7317144598732275712. Current Snapshot: MvccSnapshot[applied={T|T < 7317144598886969344}]
W20260811 01:37:35.623586 20398 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:37:37.224774 19818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:37.225008 19818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:37.229657 19818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Sending DeleteTablet for 3 replicas of tablet b4055da69d214ee2b18dcc371a10182b
I20260811 01:37:37.230607 19969 tablet_service.cc:1514] Processing DeleteTablet for tablet b4055da69d214ee2b18dcc371a10182b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:37854
I20260811 01:37:37.230691 20123 tablet_service.cc:1514] Processing DeleteTablet for tablet b4055da69d214ee2b18dcc371a10182b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56814
I20260811 01:37:37.230715 20272 tablet_service.cc:1514] Processing DeleteTablet for tablet b4055da69d214ee2b18dcc371a10182b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:38784
I20260811 01:37:37.243258 20465 tablet_replica.cc:330] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: stopping tablet replica
I20260811 01:37:37.243764 20465 raft_consensus.cc:2229] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:37.244230 20464 tablet_replica.cc:330] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: stopping tablet replica
I20260811 01:37:37.244375 20465 raft_consensus.cc:2258] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.244460 20464 raft_consensus.cc:2229] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:37.244752 20464 raft_consensus.cc:2258] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.245177 20466 tablet_replica.cc:330] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: stopping tablet replica
I20260811 01:37:37.245504 20466 raft_consensus.cc:2229] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:37.245826 20466 raft_consensus.cc:2258] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.245952 20464 ts_tablet_manager.cc:1905] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.246061 20465 ts_tablet_manager.cc:1905] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.246912 20466 ts_tablet_manager.cc:1905] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.253131 20464 ts_tablet_manager.cc:1918] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:37.253312 20464 log.cc:1196] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/b4055da69d214ee2b18dcc371a10182b
I20260811 01:37:37.253837 20464 ts_tablet_manager.cc:1939] T b4055da69d214ee2b18dcc371a10182b P 6d21046ecd274a65887d004116c2ca1b: Deleting consensus metadata
I20260811 01:37:37.254118 20466 ts_tablet_manager.cc:1918] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:37.254351 20466 log.cc:1196] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/b4055da69d214ee2b18dcc371a10182b
I20260811 01:37:37.254426 20465 ts_tablet_manager.cc:1918] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:37.254591 20465 log.cc:1196] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/b4055da69d214ee2b18dcc371a10182b
I20260811 01:37:37.255044 20465 ts_tablet_manager.cc:1939] T b4055da69d214ee2b18dcc371a10182b P 99d1765587a74bcd917069c2cd814907: Deleting consensus metadata
I20260811 01:37:37.255043 20466 ts_tablet_manager.cc:1939] T b4055da69d214ee2b18dcc371a10182b P 6ebffd0c7339431c858eb513851a441b: Deleting consensus metadata
I20260811 01:37:37.255250 19803 catalog_manager.cc:4841] TS 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293): tablet b4055da69d214ee2b18dcc371a10182b (table test-table [id=c9d4517aad6d4e00866d02243b3af9c7]) successfully deleted
I20260811 01:37:37.256246 19803 catalog_manager.cc:4841] TS 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327): tablet b4055da69d214ee2b18dcc371a10182b (table test-table [id=c9d4517aad6d4e00866d02243b3af9c7]) successfully deleted
I20260811 01:37:37.256227 19807 catalog_manager.cc:4841] TS 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903): tablet b4055da69d214ee2b18dcc371a10182b (table test-table [id=c9d4517aad6d4e00866d02243b3af9c7]) successfully deleted
Aug 11 01:37:37 dist-test-slave-0kls krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:37:37 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:37.299202 20473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.284068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.17.132.62:44731)
0811 01:37:37.284655 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.284660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.284812 (+ 152us) server_negotiation.cc:407] Connection header received
0811 01:37:37.284974 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.284978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.285043 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.285187 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:37.286644 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.287406 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.288710 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.289181 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.289281 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.293253 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:37.293258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:37.293261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:37.293299 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:37.296229 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:37.297009 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:37.297014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:37.297016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:37.297168 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:37.297549 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:37.297553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:37.297555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:37.298004 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:37.298217 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.298510 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.298775 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":300,"threads_started":1}
I20260811 01:37:37.303128 19818 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:37.303848 19818 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:37.311465 19969 tablet_service.cc:1467] Processing CreateTablet for tablet c2236991e1aa41e690b866d6895766ce (DEFAULT_TABLE table=test-table [id=c47c97c0af334f7594318d065878ce77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.311874 20272 tablet_service.cc:1467] Processing CreateTablet for tablet c2236991e1aa41e690b866d6895766ce (DEFAULT_TABLE table=test-table [id=c47c97c0af334f7594318d065878ce77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.312084 19969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2236991e1aa41e690b866d6895766ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.312379 20272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2236991e1aa41e690b866d6895766ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.315204 20123 tablet_service.cc:1467] Processing CreateTablet for tablet c2236991e1aa41e690b866d6895766ce (DEFAULT_TABLE table=test-table [id=c47c97c0af334f7594318d065878ce77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.315646 20123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2236991e1aa41e690b866d6895766ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.324321 20475 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Bootstrap starting.
I20260811 01:37:37.327142 20475 tablet_bootstrap.cc:654] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.327211 20476 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Bootstrap starting.
I20260811 01:37:37.328794 20476 tablet_bootstrap.cc:654] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.329089 20478 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Bootstrap starting.
I20260811 01:37:37.329918 20475 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: No bootstrap required, opened a new log
I20260811 01:37:37.330084 20475 ts_tablet_manager.cc:1397] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 01:37:37.330955 20475 raft_consensus.cc:348] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.331239 20475 raft_consensus.cc:374] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.331351 20475 raft_consensus.cc:729] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.331681 20475 consensus_queue.cc:260] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.332011 20478 tablet_bootstrap.cc:654] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.332744 20475 ts_tablet_manager.cc:1428] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:37.334393 20476 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: No bootstrap required, opened a new log
I20260811 01:37:37.334591 20476 ts_tablet_manager.cc:1397] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 01:37:37.335901 20478 tablet_bootstrap.cc:492] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: No bootstrap required, opened a new log
I20260811 01:37:37.335781 20476 raft_consensus.cc:348] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.336087 20476 raft_consensus.cc:374] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.336151 20478 ts_tablet_manager.cc:1397] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 01:37:37.336265 20476 raft_consensus.cc:729] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.336580 20476 consensus_queue.cc:260] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.337074 20478 raft_consensus.cc:348] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.337280 20476 ts_tablet_manager.cc:1428] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260811 01:37:37.337360 20478 raft_consensus.cc:374] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.337469 20478 raft_consensus.cc:729] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.337824 20478 consensus_queue.cc:260] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.338516 20478 ts_tablet_manager.cc:1428] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:37:37.489745 20481 raft_consensus.cc:482] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:37.490046 20481 raft_consensus.cc:504] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.491703 20481 leader_election.cc:288] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:37.510538 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.492217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:59155 (local address 127.17.132.3:35903)
0811 01:37:37.503648 (+ 11431us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.503655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.503907 (+ 252us) server_negotiation.cc:407] Connection header received
0811 01:37:37.504136 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.504144 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.504236 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.504351 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:37.505063 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.505961 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.508419 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.509376 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.509515 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.509635 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.510042 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.510191 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11283,"thread_start_us":11102,"threads_started":1}
I20260811 01:37:37.510613 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.492063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.17.132.1:59155)
0811 01:37:37.503804 (+ 11741us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:37.503822 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:37.503953 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:37.504403 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:37.504408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:37.504437 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:37.504860 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.504875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.506101 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.506106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.508262 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.508276 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.509585 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.509595 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.509861 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.509896 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:37:37.509988 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 01:37:37.510129 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11623,"mutex_wait_us":37,"spinlock_wait_cycles":1920,"thread_start_us":11418,"threads_started":1}
I20260811 01:37:37.510659 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.492063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:43327 (local address 127.17.132.1:54003)
0811 01:37:37.503167 (+ 11104us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:37.503206 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:37.504096 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:37.504526 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:37.504534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:37.504594 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:37.505049 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.505061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.506260 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.506264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.508393 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.508428 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.509752 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.509756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.509942 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.509987 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:37:37.510085 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:37:37.510224 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10886,"mutex_wait_us":17,"spinlock_wait_cycles":1408,"thread_start_us":10713,"threads_started":1}
I20260811 01:37:37.510593 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.492169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:54003 (local address 127.17.132.2:43327)
0811 01:37:37.502750 (+ 10581us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.502760 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.503370 (+ 610us) server_negotiation.cc:407] Connection header received
0811 01:37:37.504274 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.504278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.504382 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.504499 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:37.505258 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.506117 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.508551 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.509459 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.509715 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.509834 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.510134 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.510291 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10372,"thread_start_us":10183,"threads_started":1}
I20260811 01:37:37.511555 20298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2236991e1aa41e690b866d6895766ce" candidate_uuid: "6d21046ecd274a65887d004116c2ca1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b" is_pre_election: true
I20260811 01:37:37.511680 20150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2236991e1aa41e690b866d6895766ce" candidate_uuid: "6d21046ecd274a65887d004116c2ca1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99d1765587a74bcd917069c2cd814907" is_pre_election: true
I20260811 01:37:37.511833 20298 raft_consensus.cc:2454] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d21046ecd274a65887d004116c2ca1b in term 0.
I20260811 01:37:37.512014 20150 raft_consensus.cc:2454] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d21046ecd274a65887d004116c2ca1b in term 0.
I20260811 01:37:37.512444 19919 leader_election.cc:302] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 6ebffd0c7339431c858eb513851a441b; no voters:
I20260811 01:37:37.512953 20481 raft_consensus.cc:2781] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:37.513103 20481 raft_consensus.cc:482] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:37.513208 20481 raft_consensus.cc:3037] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:37.515799 20481 raft_consensus.cc:504] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.516584 20481 leader_election.cc:288] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [CANDIDATE]: Term 1 election: Requested vote from peers 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:37.516995 20150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2236991e1aa41e690b866d6895766ce" candidate_uuid: "6d21046ecd274a65887d004116c2ca1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99d1765587a74bcd917069c2cd814907"
I20260811 01:37:37.517093 20298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2236991e1aa41e690b866d6895766ce" candidate_uuid: "6d21046ecd274a65887d004116c2ca1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b"
I20260811 01:37:37.517210 20150 raft_consensus.cc:3037] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:37.517339 20298 raft_consensus.cc:3037] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:37.519564 20298 raft_consensus.cc:2454] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d21046ecd274a65887d004116c2ca1b in term 1.
I20260811 01:37:37.519572 20150 raft_consensus.cc:2454] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d21046ecd274a65887d004116c2ca1b in term 1.
I20260811 01:37:37.520008 19919 leader_election.cc:302] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 6ebffd0c7339431c858eb513851a441b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:37.520365 20481 raft_consensus.cc:2781] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:37.520834 20481 raft_consensus.cc:686] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 1 LEADER]: Becoming Leader. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Running, Role: LEADER
I20260811 01:37:37.521231 20481 consensus_queue.cc:237] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.524814 19818 catalog_manager.cc:5495] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d21046ecd274a65887d004116c2ca1b (127.17.132.1). New cstate: current_term: 1 leader_uuid: "6d21046ecd274a65887d004116c2ca1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } health_report { overall_health: UNKNOWN } } }
I20260811 01:37:37.583173 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.576781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.17.132.1:44293)
0811 01:37:37.577448 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.577452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.577473 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:37:37.577568 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.577572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.577667 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.577965 (+ 298us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:37.578312 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.579228 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.580571 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.581026 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.581167 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.581660 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:37.582352 (+ 692us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:37.582468 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.582635 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.582773 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":392,"threads_started":1}
I20260811 01:37:37.600713 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.594286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:38687 (local address 127.17.132.3:35903)
0811 01:37:37.594487 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.594492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.595159 (+ 667us) server_negotiation.cc:407] Connection header received
0811 01:37:37.595477 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.595482 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.595554 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.595657 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:37.596182 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.597057 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.598808 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.599279 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.599423 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.599920 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:37.600034 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:37.600137 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.600298 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.600390 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:37:37.600806 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.594388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35903 (local address 127.17.132.1:38687)
0811 01:37:37.595040 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:37.595056 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:37.595307 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:37.595681 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:37.595686 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:37.595698 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:37.596025 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.596034 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.597208 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.597217 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.598639 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.598653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.599481 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.599490 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.599634 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.599703 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:37.600153 (+ 450us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:37.600168 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 01:37:37.600272 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:37:37.600422 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":348,"threads_started":1}
I20260811 01:37:37.611101 20298 raft_consensus.cc:1261] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Refusing update from remote peer 6d21046ecd274a65887d004116c2ca1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:37.611101 20150 raft_consensus.cc:1261] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Refusing update from remote peer 6d21046ecd274a65887d004116c2ca1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:37.611904 20487 consensus_queue.cc:1035] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:37.612313 20481 consensus_queue.cc:1035] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:37.644939 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.638821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:57697 (local address 127.17.132.1:44293)
0811 01:37:37.639060 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:37.639069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:37.639736 (+ 667us) server_negotiation.cc:407] Connection header received
0811 01:37:37.639893 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:37.639897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:37.639962 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:37.640035 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:37.640454 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.641272 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.642923 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.643581 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.643736 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.644152 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:37.644270 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:37.644375 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:37.644518 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 01:37:37.644605 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:37:37.645017 20501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:37.638709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:44293 (local address 127.17.132.3:57697)
0811 01:37:37.639656 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:37.639671 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:37.639802 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:37.640100 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:37.640104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:37.640113 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:37:37.640331 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.640338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.641496 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.641502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.642762 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:37.642777 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:37.643758 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:37.643764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:37.643934 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:37.643975 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:37:37.644377 (+ 402us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:37:37.644391 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 01:37:37.644495 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:37:37.644645 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":639,"threads_started":1}
I20260811 01:37:37.680287 19818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:37.680507 19818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:37.684007 19818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Sending DeleteTablet for 3 replicas of tablet c2236991e1aa41e690b866d6895766ce
I20260811 01:37:37.684960 19969 tablet_service.cc:1514] Processing DeleteTablet for tablet c2236991e1aa41e690b866d6895766ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:37854
I20260811 01:37:37.684964 20272 tablet_service.cc:1514] Processing DeleteTablet for tablet c2236991e1aa41e690b866d6895766ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:38784
I20260811 01:37:37.685277 20464 tablet_replica.cc:330] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: stopping tablet replica
I20260811 01:37:37.685236 20123 tablet_service.cc:1514] Processing DeleteTablet for tablet c2236991e1aa41e690b866d6895766ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56814
I20260811 01:37:37.685447 20466 tablet_replica.cc:330] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: stopping tablet replica
I20260811 01:37:37.685499 20464 raft_consensus.cc:2229] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:37.685544 20465 tablet_replica.cc:330] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: stopping tablet replica
I20260811 01:37:37.685662 20466 raft_consensus.cc:2229] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:37.685732 20465 raft_consensus.cc:2229] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:37.685962 20465 raft_consensus.cc:2258] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.686117 20464 raft_consensus.cc:2258] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.686272 20466 raft_consensus.cc:2258] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:37.687276 20465 ts_tablet_manager.cc:1905] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.687282 20464 ts_tablet_manager.cc:1905] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.687578 20466 ts_tablet_manager.cc:1905] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:37.694312 20465 ts_tablet_manager.cc:1918] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:37.694504 20465 log.cc:1196] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/c2236991e1aa41e690b866d6895766ce
I20260811 01:37:37.694535 20466 ts_tablet_manager.cc:1918] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:37.694850 20466 log.cc:1196] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/c2236991e1aa41e690b866d6895766ce
I20260811 01:37:37.694967 20465 ts_tablet_manager.cc:1939] T c2236991e1aa41e690b866d6895766ce P 99d1765587a74bcd917069c2cd814907: Deleting consensus metadata
I20260811 01:37:37.695093 20464 ts_tablet_manager.cc:1918] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:37:37.695266 20464 log.cc:1196] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/c2236991e1aa41e690b866d6895766ce
I20260811 01:37:37.695523 20466 ts_tablet_manager.cc:1939] T c2236991e1aa41e690b866d6895766ce P 6ebffd0c7339431c858eb513851a441b: Deleting consensus metadata
I20260811 01:37:37.695734 20464 ts_tablet_manager.cc:1939] T c2236991e1aa41e690b866d6895766ce P 6d21046ecd274a65887d004116c2ca1b: Deleting consensus metadata
I20260811 01:37:37.696308 19803 catalog_manager.cc:4841] TS 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327): tablet c2236991e1aa41e690b866d6895766ce (table test-table [id=c47c97c0af334f7594318d065878ce77]) successfully deleted
I20260811 01:37:37.696985 19807 catalog_manager.cc:4841] TS 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903): tablet c2236991e1aa41e690b866d6895766ce (table test-table [id=c47c97c0af334f7594318d065878ce77]) successfully deleted
I20260811 01:37:37.697217 19803 catalog_manager.cc:4841] TS 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293): tablet c2236991e1aa41e690b866d6895766ce (table test-table [id=c47c97c0af334f7594318d065878ce77]) successfully deleted
I20260811 01:37:37.698258 19818 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:37.698938 19818 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:37.706864 19969 tablet_service.cc:1467] Processing CreateTablet for tablet 7a692bb83c884dc888321852ac0a8984 (DEFAULT_TABLE table=test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.707032 20123 tablet_service.cc:1467] Processing CreateTablet for tablet 7a692bb83c884dc888321852ac0a8984 (DEFAULT_TABLE table=test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.707197 20272 tablet_service.cc:1467] Processing CreateTablet for tablet 7a692bb83c884dc888321852ac0a8984 (DEFAULT_TABLE table=test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:37.707406 19969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a692bb83c884dc888321852ac0a8984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.707466 20123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a692bb83c884dc888321852ac0a8984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.707692 20272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a692bb83c884dc888321852ac0a8984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:37.714707 20475 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Bootstrap starting.
I20260811 01:37:37.714771 20476 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Bootstrap starting.
I20260811 01:37:37.716015 20478 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Bootstrap starting.
I20260811 01:37:37.716650 20475 tablet_bootstrap.cc:654] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.716650 20476 tablet_bootstrap.cc:654] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.717514 20478 tablet_bootstrap.cc:654] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:37.719486 20475 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: No bootstrap required, opened a new log
I20260811 01:37:37.719723 20475 ts_tablet_manager.cc:1397] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 01:37:37.720765 20475 raft_consensus.cc:348] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.721109 20475 raft_consensus.cc:374] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.721191 20475 raft_consensus.cc:729] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d21046ecd274a65887d004116c2ca1b, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.721530 20475 consensus_queue.cc:260] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.722332 20475 ts_tablet_manager.cc:1428] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:37:37.726539 20476 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: No bootstrap required, opened a new log
I20260811 01:37:37.726881 20476 ts_tablet_manager.cc:1397] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260811 01:37:37.727527 20478 tablet_bootstrap.cc:492] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: No bootstrap required, opened a new log
I20260811 01:37:37.727731 20478 ts_tablet_manager.cc:1397] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260811 01:37:37.727864 20476 raft_consensus.cc:348] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.728166 20476 raft_consensus.cc:374] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.728260 20476 raft_consensus.cc:729] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebffd0c7339431c858eb513851a441b, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.728520 20476 consensus_queue.cc:260] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.728701 20478 raft_consensus.cc:348] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.728989 20478 raft_consensus.cc:374] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:37.729085 20478 raft_consensus.cc:729] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Initialized, Role: FOLLOWER
I20260811 01:37:37.729259 20476 ts_tablet_manager.cc:1428] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:37:37.729360 20478 consensus_queue.cc:260] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.730094 20478 ts_tablet_manager.cc:1428] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 01:37:37.992367 20458 raft_consensus.cc:482] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:37:37.992775 20458 raft_consensus.cc:504] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.993759 20458 leader_election.cc:288] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:37.994573 20298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a692bb83c884dc888321852ac0a8984" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b" is_pre_election: true
I20260811 01:37:37.994562 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a692bb83c884dc888321852ac0a8984" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b" is_pre_election: true
I20260811 01:37:37.994858 20298 raft_consensus.cc:2454] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:37.994890 19999 raft_consensus.cc:2454] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 0.
I20260811 01:37:37.995679 20070 leader_election.cc:302] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ebffd0c7339431c858eb513851a441b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:37.996085 20458 raft_consensus.cc:2781] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:37:37.996263 20458 raft_consensus.cc:482] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:37:37.996371 20458 raft_consensus.cc:3037] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:37.999217 20458 raft_consensus.cc:504] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:37.999993 20458 leader_election.cc:288] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Requested vote from peers 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293), 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903)
I20260811 01:37:38.000664 20298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a692bb83c884dc888321852ac0a8984" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ebffd0c7339431c858eb513851a441b"
I20260811 01:37:38.000769 19999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a692bb83c884dc888321852ac0a8984" candidate_uuid: "99d1765587a74bcd917069c2cd814907" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d21046ecd274a65887d004116c2ca1b"
I20260811 01:37:38.000938 20298 raft_consensus.cc:3037] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:38.001025 19999 raft_consensus.cc:3037] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:38.004920 19999 raft_consensus.cc:2454] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:38.005579 20066 leader_election.cc:302] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d21046ecd274a65887d004116c2ca1b, 99d1765587a74bcd917069c2cd814907; no voters:
I20260811 01:37:38.006069 20458 raft_consensus.cc:2781] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:38.010113 20298 raft_consensus.cc:2454] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99d1765587a74bcd917069c2cd814907 in term 1.
I20260811 01:37:38.011740 20458 raft_consensus.cc:686] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Becoming Leader. State: Replica: 99d1765587a74bcd917069c2cd814907, State: Running, Role: LEADER
I20260811 01:37:38.012172 20458 consensus_queue.cc:237] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } }
I20260811 01:37:38.015713 19818 catalog_manager.cc:5495] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99d1765587a74bcd917069c2cd814907 (127.17.132.2). New cstate: current_term: 1 leader_uuid: "99d1765587a74bcd917069c2cd814907" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99d1765587a74bcd917069c2cd814907" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 43327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 } health_report { overall_health: UNKNOWN } } }
I20260811 01:37:38.045526 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:38.039735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56824 (local address 127.17.132.2:43327)
0811 01:37:38.040814 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:38.040818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:38.040834 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:37:38.040890 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:38.040894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:38.040955 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:38.041073 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:38.041498 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:38.042333 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:38.043696 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:38.044136 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:38.044274 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:38.044741 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:38.044855 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:38.044956 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:38.045133 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 01:37:38.045217 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":966,"thread_start_us":776,"threads_started":1}
I20260811 01:37:38.057001 19999 raft_consensus.cc:1261] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Refusing update from remote peer 99d1765587a74bcd917069c2cd814907: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:38.057044 20298 raft_consensus.cc:1261] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Refusing update from remote peer 99d1765587a74bcd917069c2cd814907: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:38.057667 20458 consensus_queue.cc:1035] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d21046ecd274a65887d004116c2ca1b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:38.058264 20458 consensus_queue.cc:1035] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ebffd0c7339431c858eb513851a441b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:37:38.087872 20445 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:37:39.690737 19820 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:39.690991 19820 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:37:39.695631 19820 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaae36c9b0144c298f01f470c59066f7: Sending DeleteTablet for 3 replicas of tablet 7a692bb83c884dc888321852ac0a8984
I20260811 01:37:39.696815 20272 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a692bb83c884dc888321852ac0a8984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:39 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:38784
I20260811 01:37:39.696853 19969 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a692bb83c884dc888321852ac0a8984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:39 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:37854
I20260811 01:37:39.696820 20123 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a692bb83c884dc888321852ac0a8984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:37:39 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56814
I20260811 01:37:39.698266 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19899
I20260811 01:37:39.698984 20538 tablet_replica.cc:330] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: stopping tablet replica
I20260811 01:37:39.699317 20538 raft_consensus.cc:2229] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:37:39.700004 20538 raft_consensus.cc:2258] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:39.701485 20538 ts_tablet_manager.cc:1905] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:39.711982 20538 ts_tablet_manager.cc:1918] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:39.712299 20538 log.cc:1196] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/7a692bb83c884dc888321852ac0a8984
I20260811 01:37:39.712620 20540 tablet_replica.cc:330] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: stopping tablet replica
I20260811 01:37:39.712941 20538 ts_tablet_manager.cc:1939] T 7a692bb83c884dc888321852ac0a8984 P 99d1765587a74bcd917069c2cd814907: Deleting consensus metadata
I20260811 01:37:39.713127 20540 raft_consensus.cc:2229] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:39.713546 20540 raft_consensus.cc:2258] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:39.714392 19803 catalog_manager.cc:4841] TS 99d1765587a74bcd917069c2cd814907 (127.17.132.2:43327): tablet 7a692bb83c884dc888321852ac0a8984 (table test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]) successfully deleted
I20260811 01:37:39.715152 20540 ts_tablet_manager.cc:1905] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:39.715233 20539 tablet_replica.cc:330] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: stopping tablet replica
I20260811 01:37:39.715452 20539 raft_consensus.cc:2229] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:37:39.715770 20539 raft_consensus.cc:2258] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:37:39.716820 20539 ts_tablet_manager.cc:1905] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:37:39.721297 20540 ts_tablet_manager.cc:1918] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:39.721477 20540 log.cc:1196] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/7a692bb83c884dc888321852ac0a8984
I20260811 01:37:39.721989 20540 ts_tablet_manager.cc:1939] T 7a692bb83c884dc888321852ac0a8984 P 6ebffd0c7339431c858eb513851a441b: Deleting consensus metadata
I20260811 01:37:39.723145 19807 catalog_manager.cc:4841] TS 6ebffd0c7339431c858eb513851a441b (127.17.132.3:35903): tablet 7a692bb83c884dc888321852ac0a8984 (table test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]) successfully deleted
I20260811 01:37:39.723260 20539 ts_tablet_manager.cc:1918] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:37:39.723394 20539 log.cc:1196] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/7a692bb83c884dc888321852ac0a8984
I20260811 01:37:39.723788 20539 ts_tablet_manager.cc:1939] T 7a692bb83c884dc888321852ac0a8984 P 6d21046ecd274a65887d004116c2ca1b: Deleting consensus metadata
I20260811 01:37:39.724865 19803 catalog_manager.cc:4841] TS 6d21046ecd274a65887d004116c2ca1b (127.17.132.1:44293): tablet 7a692bb83c884dc888321852ac0a8984 (table test-table [id=fe270f3c3d0c4080987be99d2aef8b6c]) successfully deleted
Aug 11 01:37:39 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:39.735101 20542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:39.700429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37862 (local address 127.17.132.1:44293)
0811 01:37:39.710646 (+ 10217us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:39.710655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:39.712395 (+ 1740us) server_negotiation.cc:407] Connection header received
0811 01:37:39.712484 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:39.712493 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:39.712598 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:39.712740 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:39.714786 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.716140 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.718347 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.719089 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.719243 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:39.728250 (+ 9007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:39.728270 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:39.728288 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:39.728330 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:39.731645 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.732619 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.732628 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.732630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.732788 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.733255 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.733259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.733262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.733711 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:39.734185 (+ 474us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:39.734474 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:37:39.734684 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10027,"thread_start_us":10243,"threads_started":1}
W20260811 01:37:39.735891 20041 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37862
W20260811 01:37:39.736660 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19899: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:39.736922 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19899
I20260811 01:37:39.767614 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20050
Aug 11 01:37:39 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:39.784922 20543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:39.768403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.17.132.2:43327)
0811 01:37:39.768986 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:39.768991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:39.769007 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:37:39.769072 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:39.769076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:39.769143 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:39.769237 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:39.770763 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.771818 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.773278 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.773753 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.773975 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:39.778569 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:39.778589 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:39.778607 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:39.778651 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:39.782039 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.782851 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.782860 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.782862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.783020 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.783439 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.783443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.783445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.783832 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:39.784067 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:39.784407 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 01:37:39.784642 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":305,"threads_started":1}
W20260811 01:37:39.785688 20190 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56830
W20260811 01:37:39.786645 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20050: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:39.786811 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20050
I20260811 01:37:39.815598 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20199
Aug 11 01:37:39 dist-test-slave-0kls krb5kdc[19772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:39.832386 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:39.816399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38806 (local address 127.17.132.3:35903)
0811 01:37:39.816998 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:39.817002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:39.817020 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:37:39.817112 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:39.817116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:39.817184 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:39.817282 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:39.818684 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.819459 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.820659 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:39.821126 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:39.821231 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:39.826341 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:39.826360 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:39.826379 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:39.826423 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:39.829551 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.830414 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.830422 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.830424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.830579 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:39.830942 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:39.830945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:39.830947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:39.831303 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:39.831542 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:39.831782 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:37:39.831960 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":332,"threads_started":1}
W20260811 01:37:39.833089 20344 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38806
W20260811 01:37:39.833745 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20199: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:39.833954 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20199
I20260811 01:37:39.862066 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 19786
I20260811 01:37:39.863490 19867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:39.984668 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 19786
2026-08-11T01:37:40Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9399 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:40 dist-test-slave-0kls krb5kdc[20548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:40 dist-test-slave-0kls krb5kdc[20548](info): set up 2 sockets
Aug 11 01:37:40 dist-test-slave-0kls krb5kdc[20548](info): commencing operation
krb5kdc: starting...
W20260811 01:37:41.175737 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.007s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 01:37:41.435746 17936 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.259s user 0.001s sys 0.009s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 01:37:41.684511 17936 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.249s user 0.000s sys 0.008s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 01:37:41.979184 17936 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.294s user 0.000s sys 0.008s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/test-user.keytab.
W20260811 01:37:42.353192 17936 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.374s user 0.000s sys 0.008s
Aug 11 01:37:42 dist-test-slave-0kls krb5kdc[20548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
W20260811 01:37:42.802377 17936 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.17.132.62: real 0.375s user 0.003s sys 0.012s
I20260811 01:37:42.803539 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43453
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:43.159626 20561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:43.159999 20561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:43.160100 20561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:43.167860 20561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:43.167992 20561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:43.168040 20561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:43.168090 20561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:43.168135 20561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:43.178614 20561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:43.180078 20561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:43.181553 20561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:43.195171 20566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:43.195132 20569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:43.195214 20567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:43.195919 20561 server_base.cc:1034] running on GCE node
I20260811 01:37:43.196887 20561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:43.198619 20561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:43.199890 20561 hybrid_clock.cc:648] HybridClock initialized: now 1786412263199840 us; error 42 us; skew 500 ppm
I20260811 01:37:43.200301 20561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:43 dist-test-slave-0kls krb5kdc[20548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412263, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:43.203904 20561 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:43.205658 20561 webserver.cc:460] Webserver started at http://127.17.132.62:45273/ using document root <none> and password file <none>
I20260811 01:37:43.206521 20561 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:43.206640 20561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:43.206933 20561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:43.210482 20561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "2b8f745b13bb458f90edef891a3b09b7"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "9a035c6653987183e9f63fed254b1c6d"
server_key_iv: "5e9709b7e32d36812e26e4fce1e07b85"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.211352 20561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "2b8f745b13bb458f90edef891a3b09b7"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "9a035c6653987183e9f63fed254b1c6d"
server_key_iv: "5e9709b7e32d36812e26e4fce1e07b85"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.218101 20561 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 01:37:43.222352 20577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:43.224015 20561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:37:43.224278 20561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "2b8f745b13bb458f90edef891a3b09b7"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "9a035c6653987183e9f63fed254b1c6d"
server_key_iv: "5e9709b7e32d36812e26e4fce1e07b85"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.224519 20561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:43.260572 20561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:43.265920 20561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:43.266271 20561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:43.287865 20561 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:43453
I20260811 01:37:43.287883 20632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:43453 every 8 connection(s)
I20260811 01:37:43.289598 20561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:43.294026 20633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:43.299552 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20561
I20260811 01:37:43.299830 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:43.300550 17936 external_mini_cluster.cc:1428] Setting key b029764c79b25ba9c3dc15c70f613647
I20260811 01:37:43.307821 20633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7: Bootstrap starting.
I20260811 01:37:43.312141 20633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:43.313323 20633 log.cc:824] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:43.316751 20633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7: No bootstrap required, opened a new log
Aug 11 01:37:43 dist-test-slave-0kls krb5kdc[20548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:43.327939 20633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } }
I20260811 01:37:43.328460 20633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:43.328591 20633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8f745b13bb458f90edef891a3b09b7, State: Initialized, Role: FOLLOWER
I20260811 01:37:43.329128 20636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:43.302962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.17.132.62:43453)
0811 01:37:43.303968 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:43.303986 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:43.304052 (+ 66us) server_negotiation.cc:407] Connection header received
0811 01:37:43.306776 (+ 2724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:43.306813 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:43.307446 (+ 633us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:43.307956 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:43.309603 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.311753 (+ 2150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.313218 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.314363 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.314517 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:43.319004 (+ 4487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:43.319021 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:43.319042 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:43.319101 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:43.323549 (+ 4448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:43.324526 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:43.324536 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:43.324547 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:43.324778 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:43.325252 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:43.325258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:43.325267 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:43.326192 (+ 925us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:43.326521 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:43.327033 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 01:37:43.327548 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":427,"threads_started":1}
I20260811 01:37:43.329386 20633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } }
I20260811 01:37:43.329684 20633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:43.329912 20633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:43.330161 20633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:43.333062 20633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } }
I20260811 01:37:43.333612 20633 leader_election.cc:302] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b8f745b13bb458f90edef891a3b09b7; no voters:
I20260811 01:37:43.334331 20633 leader_election.cc:288] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:43.334502 20638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:43.335327 20638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [term 1 LEADER]: Becoming Leader. State: Replica: 2b8f745b13bb458f90edef891a3b09b7, State: Running, Role: LEADER
I20260811 01:37:43.335963 20638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } }
I20260811 01:37:43.337000 20633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:43.339138 20640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b8f745b13bb458f90edef891a3b09b7. Latest consensus state: current_term: 1 leader_uuid: "2b8f745b13bb458f90edef891a3b09b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } } }
I20260811 01:37:43.339690 20640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:43.339967 20639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b8f745b13bb458f90edef891a3b09b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8f745b13bb458f90edef891a3b09b7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43453 } } }
I20260811 01:37:43.340402 20639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:43.342536 20643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:43.348274 20643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:43.357969 20643 catalog_manager.cc:1347] Generated new cluster ID: 98fd35728aa24ccda46c565c90a6cb96
I20260811 01:37:43.358150 20643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:43.373569 20643 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:43.375815 20643 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:43.395658 20643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b8f745b13bb458f90edef891a3b09b7: Generated new TSK 0
I20260811 01:37:43.396653 20643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:43.470796 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:43.847683 20659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:43.848070 20659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:43.848237 20659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:43.856170 20659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:43.856396 20659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:43.856611 20659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:43.867792 20659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:43.869206 20659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:43.870709 20659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:43.885526 20666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:43.885524 20665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:43.885932 20668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:43.886849 20659 server_base.cc:1034] running on GCE node
I20260811 01:37:43.887742 20659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:43.888949 20659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:43.890280 20659 hybrid_clock.cc:648] HybridClock initialized: now 1786412263890159 us; error 79 us; skew 500 ppm
I20260811 01:37:43.890790 20659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:43 dist-test-slave-0kls krb5kdc[20548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412263, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:43.895051 20659 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:43.896996 20659 webserver.cc:460] Webserver started at http://127.17.132.1:43281/ using document root <none> and password file <none>
I20260811 01:37:43.897938 20659 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:43.898110 20659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:43.898489 20659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:43.902024 20659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "80ce9faf7a87470d94a88000b578f175"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "4f164a6f5d72229658f5efb3ce957abb"
server_key_iv: "cf7ddbefc62194da9521bb8b36e3fa49"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.903070 20659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "80ce9faf7a87470d94a88000b578f175"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "4f164a6f5d72229658f5efb3ce957abb"
server_key_iv: "cf7ddbefc62194da9521bb8b36e3fa49"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.909425 20659 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:37:43.914397 20676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:43.916371 20659 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260811 01:37:43.916661 20659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "80ce9faf7a87470d94a88000b578f175"
format_stamp: "Formatted at 2026-08-11 01:37:43 on dist-test-slave-0kls"
server_key: "4f164a6f5d72229658f5efb3ce957abb"
server_key_iv: "cf7ddbefc62194da9521bb8b36e3fa49"
server_key_version: "encryptionkey@0"
I20260811 01:37:43.916919 20659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:43.939144 20659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:43.944155 20659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:43.944507 20659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:43.945607 20659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:43.947203 20659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:43.947289 20659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:43.947450 20659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:43.947515 20659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:43.984038 20659 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:39251
I20260811 01:37:43.984092 20794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:39251 every 8 connection(s)
I20260811 01:37:43.985427 20659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:43.989991 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20659
I20260811 01:37:43.990222 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:43.991111 17936 external_mini_cluster.cc:1428] Setting key 653c6045775808bc72dfc599e4bf5091
Aug 11 01:37:43 dist-test-slave-0kls krb5kdc[20548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412263, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:44.011667 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:43.988197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:51403 (local address 127.17.132.62:43453)
0811 01:37:43.988706 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:43.988711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:43.992447 (+ 3736us) server_negotiation.cc:407] Connection header received
0811 01:37:43.992508 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:43.992511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:43.992577 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:43.992663 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:43.994783 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.996016 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.997709 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.998460 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.998625 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:44.003098 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:44.003104 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:44.003108 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:44.003169 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:44.007180 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:44.008392 (+ 1212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:44.008399 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:44.008403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:44.008577 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:44.009175 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:44.009183 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:44.009189 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:44.009601 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:44.009814 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:44.010851 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0811 01:37:44.011135 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":291,"threads_started":1}
I20260811 01:37:44.012753 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:43.988709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43453 (local address 127.17.132.1:51403)
0811 01:37:43.989497 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:43.989565 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:43.992061 (+ 2496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:43.993081 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:43.993093 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:43.993939 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:43.994575 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:43.994595 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.996212 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.996217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:43.997537 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:43.997550 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:43.998719 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:43.998725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:43.998962 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:43.999723 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:43.999766 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:44.002734 (+ 2968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:44.007385 (+ 4651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:44.007399 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:44.007422 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:44.008200 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:44.008716 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:44.008723 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:44.008729 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:44.009015 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:44.009819 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:44.009831 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:44.010350 (+ 519us) client_negotiation.cc:769] Sending connection context
0811 01:37:44.010712 (+ 362us) client_negotiation.cc:240] Negotiation successful
0811 01:37:44.011347 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":278,"threads_started":1}
I20260811 01:37:44.014424 20795 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43453
I20260811 01:37:44.014775 20795 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:44.015579 20795 heartbeater.cc:511] Master 127.17.132.62:43453 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:44.018060 20596 ts_manager.cc:194] Registered new tserver with Master: 80ce9faf7a87470d94a88000b578f175 (127.17.132.1:39251)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:37:44.019718 20596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:51403
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:44.050729 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:44.411356 20803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:44.411758 20803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:44.411926 20803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:44.420212 20803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:44.420394 20803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:44.420591 20803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:44.431140 20803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:44.432791 20803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:44.434648 20803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:44.448709 20809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:44.448745 20812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:44.448654 20810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:44.450006 20803 server_base.cc:1034] running on GCE node
I20260811 01:37:44.450721 20803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:44.451771 20803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:44.453033 20803 hybrid_clock.cc:648] HybridClock initialized: now 1786412264452977 us; error 48 us; skew 500 ppm
I20260811 01:37:44.453408 20803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:44 dist-test-slave-0kls krb5kdc[20548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412264, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:44.457345 20803 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:44.459285 20803 webserver.cc:460] Webserver started at http://127.17.132.2:44411/ using document root <none> and password file <none>
I20260811 01:37:44.460489 20803 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:44.460698 20803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:44.461052 20803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:44.465664 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "fff701740a994f5d8a11e8fade4f9d32"
format_stamp: "Formatted at 2026-08-11 01:37:44 on dist-test-slave-0kls"
server_key: "3dfa506d042901bb9ff4386a757f1a76"
server_key_iv: "b95552b7925370298836df080eae5c68"
server_key_version: "encryptionkey@0"
I20260811 01:37:44.466759 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "fff701740a994f5d8a11e8fade4f9d32"
format_stamp: "Formatted at 2026-08-11 01:37:44 on dist-test-slave-0kls"
server_key: "3dfa506d042901bb9ff4386a757f1a76"
server_key_iv: "b95552b7925370298836df080eae5c68"
server_key_version: "encryptionkey@0"
I20260811 01:37:44.473279 20803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 01:37:44.477977 20819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:44.479875 20803 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:37:44.480134 20803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "fff701740a994f5d8a11e8fade4f9d32"
format_stamp: "Formatted at 2026-08-11 01:37:44 on dist-test-slave-0kls"
server_key: "3dfa506d042901bb9ff4386a757f1a76"
server_key_iv: "b95552b7925370298836df080eae5c68"
server_key_version: "encryptionkey@0"
I20260811 01:37:44.480391 20803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:44.510300 20803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:44.515367 20803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:44.515702 20803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:44.516775 20803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:44.518303 20803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:44.518379 20803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:44.518559 20803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:44.518611 20803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:44.556742 20803 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:32783
I20260811 01:37:44.556912 20937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:32783 every 8 connection(s)
I20260811 01:37:44.558518 20803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:44.566790 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20803
I20260811 01:37:44.566990 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:44.567490 17936 external_mini_cluster.cc:1428] Setting key 17d07a472e032b91b5de12405f55305c
Aug 11 01:37:44 dist-test-slave-0kls krb5kdc[20548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412264, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:44.584308 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:44.561423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:44577 (local address 127.17.132.62:43453)
0811 01:37:44.562006 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:44.562011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:44.562985 (+ 974us) server_negotiation.cc:407] Connection header received
0811 01:37:44.565231 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:44.565238 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:44.565353 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:44.565495 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:44.567763 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:44.568763 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:44.570752 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:44.571284 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:44.571458 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:44.575788 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:44.575795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:44.575798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:44.575843 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:44.580123 (+ 4280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:44.581143 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:44.581152 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:44.581159 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:44.581391 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:44.581935 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:44.581945 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:44.581952 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:44.582425 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:44.582606 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:44.583386 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 01:37:44.583701 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":311,"threads_started":1}
I20260811 01:37:44.585059 20941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:44.561988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43453 (local address 127.17.132.2:44577)
0811 01:37:44.562790 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:44.562833 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:44.564877 (+ 2044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:44.565940 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:44.565956 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:44.566626 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:44.567452 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:44.567512 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:44.568969 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:44.568974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:44.570558 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:44.570575 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:44.571584 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:44.571592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:44.571884 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:44.572709 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:44.572738 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:44.575428 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:44.580376 (+ 4948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:44.580385 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:44.580403 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:44.580957 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:44.581531 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:44.581534 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:44.581536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:44.581752 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:44.582562 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:44.582569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:44.582952 (+ 383us) client_negotiation.cc:769] Sending connection context
0811 01:37:44.583195 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 01:37:44.583639 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":322,"threads_started":1}
I20260811 01:37:44.586992 20938 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43453
I20260811 01:37:44.587338 20938 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:44.588120 20938 heartbeater.cc:511] Master 127.17.132.62:43453 requested a full tablet report, sending...
I20260811 01:37:44.590057 20596 ts_manager.cc:194] Registered new tserver with Master: fff701740a994f5d8a11e8fade4f9d32 (127.17.132.2:32783)
I20260811 01:37:44.591558 20596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:44577
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:44.626104 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:44.988572 20945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:44.988960 20945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:44.989114 20945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:44.997352 20945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:44.997490 20945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:44.997611 20945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:45.008273 20945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:45.009712 20945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:45.011281 20945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:37:45.023455 20795 heartbeater.cc:503] Master 127.17.132.62:43453 was elected leader, sending a full tablet report...
W20260811 01:37:45.026856 20950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:45.027034 20953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:45.027061 20951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:45.028592 20945 server_base.cc:1034] running on GCE node
I20260811 01:37:45.029480 20945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:45.030725 20945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:45.032011 20945 hybrid_clock.cc:648] HybridClock initialized: now 1786412265031949 us; error 53 us; skew 500 ppm
I20260811 01:37:45.032418 20945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:45 dist-test-slave-0kls krb5kdc[20548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:45.040741 20945 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:45.042819 20945 webserver.cc:460] Webserver started at http://127.17.132.3:42559/ using document root <none> and password file <none>
I20260811 01:37:45.043807 20945 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:45.043988 20945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:45.044353 20945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:45.047863 20945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "715482d1c19b40f9859eb60f57180859"
format_stamp: "Formatted at 2026-08-11 01:37:45 on dist-test-slave-0kls"
server_key: "05e79681076b6d2af5b8faa902390abe"
server_key_iv: "e4e670acaf10a9d5e30705312ebb6629"
server_key_version: "encryptionkey@0"
I20260811 01:37:45.048875 20945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "715482d1c19b40f9859eb60f57180859"
format_stamp: "Formatted at 2026-08-11 01:37:45 on dist-test-slave-0kls"
server_key: "05e79681076b6d2af5b8faa902390abe"
server_key_iv: "e4e670acaf10a9d5e30705312ebb6629"
server_key_version: "encryptionkey@0"
I20260811 01:37:45.055491 20945 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 01:37:45.060176 20960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:45.062121 20945 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 01:37:45.062367 20945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "715482d1c19b40f9859eb60f57180859"
format_stamp: "Formatted at 2026-08-11 01:37:45 on dist-test-slave-0kls"
server_key: "05e79681076b6d2af5b8faa902390abe"
server_key_iv: "e4e670acaf10a9d5e30705312ebb6629"
server_key_version: "encryptionkey@0"
I20260811 01:37:45.062623 20945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:45.083415 20945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:45.088356 20945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:45.088680 20945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:45.089879 20945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:45.091396 20945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:45.091509 20945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:45.091665 20945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:45.091741 20945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:45.128577 20945 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:32909
I20260811 01:37:45.128613 21079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:32909 every 8 connection(s)
I20260811 01:37:45.130249 20945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:45.131785 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 20945
I20260811 01:37:45.131971 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:45.132431 17936 external_mini_cluster.cc:1428] Setting key 2fcdbcab2d414700df92d08328132094
Aug 11 01:37:45 dist-test-slave-0kls krb5kdc[20548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412265, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:45.154619 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:45.133088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:39395 (local address 127.17.132.62:43453)
0811 01:37:45.133631 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:45.133639 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:45.134990 (+ 1351us) server_negotiation.cc:407] Connection header received
0811 01:37:45.136973 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:45.136978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:45.137085 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:45.137243 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:45.139033 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:45.139889 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:45.141611 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:45.142189 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:45.142380 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:45.147026 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:45.147032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:45.147036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:45.147082 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:45.150658 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:45.151704 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:45.151709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:45.151712 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:45.151871 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:45.152444 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:45.152448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:45.152451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:45.152795 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:45.152971 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:45.153897 (+ 926us) server_negotiation.cc:299] Negotiation successful
0811 01:37:45.154200 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":270,"threads_started":1}
I20260811 01:37:45.155740 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:45.133692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43453 (local address 127.17.132.3:39395)
0811 01:37:45.134838 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:45.134885 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:45.136692 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:45.137506 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:45.137515 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:45.138167 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:45.138846 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:45.138866 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:45.140075 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:45.140080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:45.141411 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:45.141427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:45.142512 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:45.142524 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:45.142837 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:45.143671 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:45.143707 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:45.146461 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:45.150898 (+ 4437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:45.150917 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:45.150936 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:45.151506 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:45.152017 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:45.152023 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:45.152026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:45.152286 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:45.152948 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:45.152958 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:45.153412 (+ 454us) client_negotiation.cc:769] Sending connection context
0811 01:37:45.153728 (+ 316us) client_negotiation.cc:240] Negotiation successful
0811 01:37:45.154423 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":507,"threads_started":1}
I20260811 01:37:45.157617 21080 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43453
I20260811 01:37:45.158110 21080 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:45.159169 21080 heartbeater.cc:511] Master 127.17.132.62:43453 requested a full tablet report, sending...
I20260811 01:37:45.161540 20596 ts_manager.cc:194] Registered new tserver with Master: 715482d1c19b40f9859eb60f57180859 (127.17.132.3:32909)
I20260811 01:37:45.162720 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:37:45.162911 20596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:39395
W20260811 01:37:45.205559 21082 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:45.202737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34268 (local address 127.17.132.62:43453)
0811 01:37:45.203062 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:45.203070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:45.203398 (+ 328us) server_negotiation.cc:407] Connection header received
0811 01:37:45.203636 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:45.203641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:45.203711 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:45.203822 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:45.205248 (+ 1426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34268: BlockingRecv error: recv got EOF from 127.0.0.1:34268 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
I20260811 01:37:45.209501 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20659
W20260811 01:37:45.212564 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20659: Not authorized: Client connection negotiation failed: client connection to 127.17.132.1:39251: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:37:45.212781 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20659
I20260811 01:37:45.232791 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20803
W20260811 01:37:45.235971 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20803: Not authorized: Client connection negotiation failed: client connection to 127.17.132.2:32783: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:37:45.236171 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20803
I20260811 01:37:45.256736 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20945
W20260811 01:37:45.259856 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20945: Not authorized: Client connection negotiation failed: client connection to 127.17.132.3:32909: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:37:45.260035 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20945
I20260811 01:37:45.281033 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 20561
I20260811 01:37:45.282409 20628 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:45.391717 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 20561
2026-08-11T01:37:45Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (5402 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:45 dist-test-slave-0kls krb5kdc[21102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:45 dist-test-slave-0kls krb5kdc[21102](info): set up 2 sockets
Aug 11 01:37:45 dist-test-slave-0kls krb5kdc[21102](info): commencing operation
krb5kdc: starting...
W20260811 01:37:46.575397 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:46 dist-test-slave-0kls krb5kdc[21102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:46.826270 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45495
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:45495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:47.183413 21116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:47.183739 21116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:47.183940 21116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:47.191812 21116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:47.191962 21116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:47.192091 21116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:47.192211 21116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:47.192322 21116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:47.203679 21116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:45495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:47.205228 21116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:47.206818 21116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:47.220068 21122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:47.220099 21126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:47.220144 21123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:47.220799 21116 server_base.cc:1034] running on GCE node
I20260811 01:37:47.221742 21116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:47.223377 21116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:47.224633 21116 hybrid_clock.cc:648] HybridClock initialized: now 1786412267224589 us; error 41 us; skew 500 ppm
I20260811 01:37:47.225028 21116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:47 dist-test-slave-0kls krb5kdc[21102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412267, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:47.228430 21116 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:47.230266 21116 webserver.cc:460] Webserver started at http://127.17.132.62:37249/ using document root <none> and password file <none>
I20260811 01:37:47.231029 21116 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:47.231187 21116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:47.231540 21116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:47.234922 21116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "6d4a5fdc82e242dab4e342d44889cb3c"
format_stamp: "Formatted at 2026-08-11 01:37:47 on dist-test-slave-0kls"
server_key: "6356699a2998927b6d06d4aa6cb8fcef"
server_key_iv: "561b6d7ffec786984095d7cf62d4c1e3"
server_key_version: "encryptionkey@0"
I20260811 01:37:47.235811 21116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "6d4a5fdc82e242dab4e342d44889cb3c"
format_stamp: "Formatted at 2026-08-11 01:37:47 on dist-test-slave-0kls"
server_key: "6356699a2998927b6d06d4aa6cb8fcef"
server_key_iv: "561b6d7ffec786984095d7cf62d4c1e3"
server_key_version: "encryptionkey@0"
I20260811 01:37:47.241564 21116 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 01:37:47.245332 21134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:47.246842 21116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:47.247051 21116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "6d4a5fdc82e242dab4e342d44889cb3c"
format_stamp: "Formatted at 2026-08-11 01:37:47 on dist-test-slave-0kls"
server_key: "6356699a2998927b6d06d4aa6cb8fcef"
server_key_iv: "561b6d7ffec786984095d7cf62d4c1e3"
server_key_version: "encryptionkey@0"
I20260811 01:37:47.247285 21116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:47.268530 21116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:47.273576 21116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:47.273978 21116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:47.294977 21116 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:45495
I20260811 01:37:47.294974 21189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:45495 every 8 connection(s)
I20260811 01:37:47.296870 21116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:47.301290 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21116
I20260811 01:37:47.301577 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:47.301915 21190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:47.302445 17936 external_mini_cluster.cc:1428] Setting key 497c43b003b2b851472cfe804692d6c5
I20260811 01:37:47.318506 21190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c: Bootstrap starting.
Aug 11 01:37:47 dist-test-slave-0kls krb5kdc[21102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:47.322405 21190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:47.323652 21190 log.cc:824] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:47.326893 21190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c: No bootstrap required, opened a new log
I20260811 01:37:47.328719 21195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:47.304542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49244 (local address 127.17.132.62:45495)
0811 01:37:47.305562 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:47.305575 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:47.305634 (+ 59us) server_negotiation.cc:407] Connection header received
0811 01:37:47.307583 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:47.307609 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:47.308094 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:47.308517 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:47.310665 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:47.312143 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:47.314217 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:47.315035 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:47.315214 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:47.320503 (+ 5289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:47.320513 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:47.320528 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:47.320595 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:47.324148 (+ 3553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:47.325032 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:47.325040 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:47.325047 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:47.325247 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:47.325688 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:47.325692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:47.325694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:47.326351 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:47.326694 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:47.327187 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 01:37:47.327668 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":471,"threads_started":1}
I20260811 01:37:47.333606 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:37:47.336431 21190 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } }
I20260811 01:37:47.336916 21190 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:47.337036 21190 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4a5fdc82e242dab4e342d44889cb3c, State: Initialized, Role: FOLLOWER
I20260811 01:37:47.337695 21190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } }
I20260811 01:37:47.338061 21190 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:47.338271 21190 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:47.338461 21190 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:47.341642 21190 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } }
I20260811 01:37:47.342339 21190 leader_election.cc:302] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d4a5fdc82e242dab4e342d44889cb3c; no voters:
I20260811 01:37:47.343150 21190 leader_election.cc:288] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:47.343277 21198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:47.344746 21198 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [term 1 LEADER]: Becoming Leader. State: Replica: 6d4a5fdc82e242dab4e342d44889cb3c, State: Running, Role: LEADER
I20260811 01:37:47.345461 21198 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } }
I20260811 01:37:47.346046 21190 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:47.348892 21199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } } }
I20260811 01:37:47.349416 21199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:47.350687 21200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d4a5fdc82e242dab4e342d44889cb3c. Latest consensus state: current_term: 1 leader_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d4a5fdc82e242dab4e342d44889cb3c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45495 } } }
I20260811 01:37:47.351125 21200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:47.352377 21203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:47.359637 21203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:47.384111 21203 catalog_manager.cc:1347] Generated new cluster ID: b90976c88e1948b398b0af430ea2dd03
I20260811 01:37:47.384305 21203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:47.387887 21217 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:37:47.405726 21195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:47.395822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49258 (local address 127.17.132.62:45495)
0811 01:37:47.396018 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:47.396025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:47.396703 (+ 678us) server_negotiation.cc:407] Connection header received
0811 01:37:47.396877 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:47.396883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:47.396985 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:47.397106 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:47.398385 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:47.399540 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:47.401468 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:47.402253 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:47.402406 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:47.403706 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:47.403714 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:47.403722 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:37:47.404728 (+ 1006us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:47.404799 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:37:47.404838 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:47.404978 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:47.405162 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 01:37:47.405300 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":67}
I20260811 01:37:47.407979 21203 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:47.410241 21203 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:47.424947 21203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d4a5fdc82e242dab4e342d44889cb3c: Generated new TSK 0
I20260811 01:37:47.426039 21203 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:37:47.434793 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21116
I20260811 01:37:47.436075 21184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:47.531791 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21116
2026-08-11T01:37:47Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2134 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:47 dist-test-slave-0kls krb5kdc[21227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:47 dist-test-slave-0kls krb5kdc[21227](info): set up 2 sockets
Aug 11 01:37:47 dist-test-slave-0kls krb5kdc[21227](info): commencing operation
krb5kdc: starting...
W20260811 01:37:48.699687 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:48 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:48.958568 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44115
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:44115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:49.309700 21240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:49.310081 21240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:49.310186 21240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:49.317710 21240 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:49.317873 21240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:49.317922 21240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:49.317975 21240 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:49.318022 21240 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:49.328426 21240 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:44115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:49.329912 21240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:49.331261 21240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:49.344092 21245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:49.344146 21246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:49.344085 21248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:49.345144 21240 server_base.cc:1034] running on GCE node
I20260811 01:37:49.346179 21240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:49.347777 21240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:49.349031 21240 hybrid_clock.cc:648] HybridClock initialized: now 1786412269348972 us; error 52 us; skew 500 ppm
I20260811 01:37:49.349413 21240 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:49 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412269, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:49.352705 21240 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:49.354394 21240 webserver.cc:460] Webserver started at http://127.17.132.62:33467/ using document root <none> and password file <none>
I20260811 01:37:49.355170 21240 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:49.355329 21240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:49.355686 21240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:49.359083 21240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "9b43d2435b0241318e32b348dee45324"
format_stamp: "Formatted at 2026-08-11 01:37:49 on dist-test-slave-0kls"
server_key: "633d7abc70ee9343377319a0512f9baf"
server_key_iv: "b1338228a4cf5fa8245944eae47383f5"
server_key_version: "encryptionkey@0"
I20260811 01:37:49.359930 21240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "9b43d2435b0241318e32b348dee45324"
format_stamp: "Formatted at 2026-08-11 01:37:49 on dist-test-slave-0kls"
server_key: "633d7abc70ee9343377319a0512f9baf"
server_key_iv: "b1338228a4cf5fa8245944eae47383f5"
server_key_version: "encryptionkey@0"
I20260811 01:37:49.365839 21240 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:37:49.369709 21255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:49.371423 21240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:49.371678 21240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "9b43d2435b0241318e32b348dee45324"
format_stamp: "Formatted at 2026-08-11 01:37:49 on dist-test-slave-0kls"
server_key: "633d7abc70ee9343377319a0512f9baf"
server_key_iv: "b1338228a4cf5fa8245944eae47383f5"
server_key_version: "encryptionkey@0"
I20260811 01:37:49.371912 21240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:49.398175 21240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:49.402757 21240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:49.403095 21240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:49.423868 21240 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:44115
I20260811 01:37:49.423910 21308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:44115 every 8 connection(s)
I20260811 01:37:49.426066 21240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:49.430686 21309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:49.434677 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21240
I20260811 01:37:49.434942 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:49.435635 17936 external_mini_cluster.cc:1428] Setting key 491750965ac4b9691d59338a7b05b185
I20260811 01:37:49.446167 21309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324: Bootstrap starting.
I20260811 01:37:49.450441 21309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:49.451647 21309 log.cc:824] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:37:49 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:49.456146 21309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324: No bootstrap required, opened a new log
I20260811 01:37:49.464044 21313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:49.438029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58596 (local address 127.17.132.62:44115)
0811 01:37:49.439159 (+ 1130us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:49.439177 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:49.439234 (+ 57us) server_negotiation.cc:407] Connection header received
0811 01:37:49.441141 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:49.441183 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:49.441898 (+ 715us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:49.442433 (+ 535us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:49.443880 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:49.446046 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:49.447701 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:49.448906 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:49.449122 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:49.454138 (+ 5016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:49.454152 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:49.454173 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:49.454243 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:49.458727 (+ 4484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:49.459557 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:49.459567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:49.459579 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:49.459840 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:49.460280 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:49.460286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:49.460289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:49.461120 (+ 831us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:49.461460 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:49.461884 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 01:37:49.462426 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":871,"thread_start_us":621,"threads_started":1}
I20260811 01:37:49.466977 21309 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } }
I20260811 01:37:49.467411 21309 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:49.467545 21309 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b43d2435b0241318e32b348dee45324, State: Initialized, Role: FOLLOWER
I20260811 01:37:49.468322 21309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } }
I20260811 01:37:49.468621 21309 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:49.468776 21309 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:49.468956 21309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:49.471410 21309 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } }
I20260811 01:37:49.471966 21309 leader_election.cc:302] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b43d2435b0241318e32b348dee45324; no voters:
I20260811 01:37:49.472612 21309 leader_election.cc:288] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:49.472782 21316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:49.474830 21316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [term 1 LEADER]: Becoming Leader. State: Replica: 9b43d2435b0241318e32b348dee45324, State: Running, Role: LEADER
I20260811 01:37:49.475430 21309 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:49.475446 21316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } }
I20260811 01:37:49.479146 21317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b43d2435b0241318e32b348dee45324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } } }
I20260811 01:37:49.479568 21317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:49.479228 21318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b43d2435b0241318e32b348dee45324. Latest consensus state: current_term: 1 leader_uuid: "9b43d2435b0241318e32b348dee45324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b43d2435b0241318e32b348dee45324" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44115 } } }
I20260811 01:37:49.479725 21318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:49.481102 21324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:49.490991 21324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:49.503693 21324 catalog_manager.cc:1347] Generated new cluster ID: 586d4bba9fc54654a095d5e8994a7065
I20260811 01:37:49.503829 21324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:49.549934 21324 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:49.552055 21324 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:49.560948 21324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b43d2435b0241318e32b348dee45324: Generated new TSK 0
I20260811 01:37:49.562019 21324 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:49.634403 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:50.007128 21338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:50.007442 21338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:50.007618 21338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:50.016510 21338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:50.016701 21338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:50.016885 21338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:50.027449 21338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:50.029089 21338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:50.030690 21338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:50.044772 21343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:50.044826 21346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:50.044726 21344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:50.045516 21338 server_base.cc:1034] running on GCE node
I20260811 01:37:50.046283 21338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:50.047372 21338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:50.048619 21338 hybrid_clock.cc:648] HybridClock initialized: now 1786412270048578 us; error 38 us; skew 500 ppm
I20260811 01:37:50.048969 21338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:50 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412270, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:50.057578 21338 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:50.059345 21338 webserver.cc:460] Webserver started at http://127.17.132.1:40327/ using document root <none> and password file <none>
I20260811 01:37:50.060155 21338 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:50.060313 21338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:50.060667 21338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:50.064045 21338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "cc9b0ebf16fe4a6db78decd7856b76e6"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "51c6ba2517dbf3c3549cd43cf69e7b26"
server_key_iv: "477b04b2363f062d42bc9d33dc609d70"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.064888 21338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "cc9b0ebf16fe4a6db78decd7856b76e6"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "51c6ba2517dbf3c3549cd43cf69e7b26"
server_key_iv: "477b04b2363f062d42bc9d33dc609d70"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.070959 21338 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:37:50.075314 21354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.077071 21338 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260811 01:37:50.077304 21338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "cc9b0ebf16fe4a6db78decd7856b76e6"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "51c6ba2517dbf3c3549cd43cf69e7b26"
server_key_iv: "477b04b2363f062d42bc9d33dc609d70"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.077540 21338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:50.117125 21338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:50.121595 21338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:50.121999 21338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:50.123145 21338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:50.124635 21338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:50.124756 21338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.124918 21338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:50.124994 21338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.161599 21338 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:39025
I20260811 01:37:50.161676 21478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:39025 every 8 connection(s)
I20260811 01:37:50.163084 21338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:50.163937 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21338
I20260811 01:37:50.164222 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:50.165041 17936 external_mini_cluster.cc:1428] Setting key 7bec900f3df1d9e97eb6fe16dcb4510c
Aug 11 01:37:50 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412270, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:50.189343 21481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:50.166296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:58369 (local address 127.17.132.62:44115)
0811 01:37:50.166807 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:50.166813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:50.168166 (+ 1353us) server_negotiation.cc:407] Connection header received
0811 01:37:50.171347 (+ 3181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:50.171352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:50.171428 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:50.171527 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:50.173951 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.174921 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.177672 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.178158 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.178321 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:50.182615 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:50.182622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:50.182626 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:50.182676 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:50.185878 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:50.186777 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:50.186783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:50.186788 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:50.186933 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:50.187450 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:50.187455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:50.187458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:50.187757 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:50.187926 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:50.188700 (+ 774us) server_negotiation.cc:299] Negotiation successful
0811 01:37:50.188956 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":250,"threads_started":1}
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:50.190492 21482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:50.167013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44115 (local address 127.17.132.1:58369)
0811 01:37:50.167964 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:50.168029 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:50.170963 (+ 2934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:50.171857 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:50.171874 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:50.172772 (+ 898us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:50.173694 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:50.173724 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.175117 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.175126 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:50.177456 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:50.177476 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.178437 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.178446 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:50.178707 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:50.179549 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:50.179574 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:50.182301 (+ 2727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:50.186075 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:50.186086 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:50.186106 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:50.186617 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:50.187057 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:50.187063 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:50.187067 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:50.187316 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:50.187910 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:50.187919 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:50.188301 (+ 382us) client_negotiation.cc:769] Sending connection context
0811 01:37:50.188580 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:37:50.189188 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":375,"threads_started":1}
I20260811 01:37:50.192322 21479 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44115
I20260811 01:37:50.192651 21479 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:37:50.194000 21479 heartbeater.cc:511] Master 127.17.132.62:44115 requested a full tablet report, sending...
I20260811 01:37:50.196553 21274 ts_manager.cc:194] Registered new tserver with Master: cc9b0ebf16fe4a6db78decd7856b76e6 (127.17.132.1:39025)
I20260811 01:37:50.198333 21274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:58369
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:50.223851 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:50.595211 21485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:50.595533 21485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:50.595714 21485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:50.603997 21485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:50.604156 21485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:50.604372 21485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:50.615093 21485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:50.616660 21485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:50.618247 21485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:50.633114 21490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:50.633402 21491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:50.633545 21493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:50.635365 21485 server_base.cc:1034] running on GCE node
I20260811 01:37:50.636104 21485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:50.637218 21485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:50.638469 21485 hybrid_clock.cc:648] HybridClock initialized: now 1786412270638427 us; error 41 us; skew 500 ppm
I20260811 01:37:50.638849 21485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:50 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412270, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:50.642405 21485 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:50.644289 21485 webserver.cc:460] Webserver started at http://127.17.132.2:32969/ using document root <none> and password file <none>
I20260811 01:37:50.645134 21485 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:50.645296 21485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:50.645835 21485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:50.649247 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "fe9ac5b15aca4b988dbda0c4384faf73"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "19a40401c34bc5323a0a3c4ff9e51028"
server_key_iv: "3e6d726ee7895116fbb13a2faa95b36e"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.650368 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "fe9ac5b15aca4b988dbda0c4384faf73"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "19a40401c34bc5323a0a3c4ff9e51028"
server_key_iv: "3e6d726ee7895116fbb13a2faa95b36e"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.656491 21485 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:37:50.660713 21500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.662611 21485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 01:37:50.662863 21485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "fe9ac5b15aca4b988dbda0c4384faf73"
format_stamp: "Formatted at 2026-08-11 01:37:50 on dist-test-slave-0kls"
server_key: "19a40401c34bc5323a0a3c4ff9e51028"
server_key_iv: "3e6d726ee7895116fbb13a2faa95b36e"
server_key_version: "encryptionkey@0"
I20260811 01:37:50.663117 21485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:50.683754 21485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:50.689226 21485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:50.689594 21485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:50.690750 21485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:50.692266 21485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:50.692382 21485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.692548 21485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:50.692624 21485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:50.727748 21485 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:35305
I20260811 01:37:50.727793 21622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:35305 every 8 connection(s)
I20260811 01:37:50.729176 21485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:50.730902 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21485
I20260811 01:37:50.731124 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:50.731606 17936 external_mini_cluster.cc:1428] Setting key 338e2e2be961ef1810201665d3cf3a02
Aug 11 01:37:50 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412270, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:50.754020 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:50.732339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:44725 (local address 127.17.132.62:44115)
0811 01:37:50.732911 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:50.732916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:50.733917 (+ 1001us) server_negotiation.cc:407] Connection header received
0811 01:37:50.735847 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:50.735856 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:50.735954 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:50.736077 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:50.737678 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.738899 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.740658 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.741508 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.741669 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:50.746255 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:50.746264 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:50.746272 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:50.746324 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:50.750254 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:50.751158 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:50.751167 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:50.751173 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:50.751339 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:50.751809 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:50.751817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:50.751822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:50.752256 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:50.752421 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:50.753198 (+ 777us) server_negotiation.cc:299] Negotiation successful
0811 01:37:50.753472 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":328,"threads_started":1}
I20260811 01:37:50.754894 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:50.732902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44115 (local address 127.17.132.2:44725)
0811 01:37:50.733722 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:50.733785 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:50.735541 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:50.736331 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:50.736339 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:50.736881 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:50.737471 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:50.737489 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.739124 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.739130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:50.740471 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:50.740485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:50.741939 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:50.741951 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:50.742340 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:50.743178 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:50.743224 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:50.745939 (+ 2715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:50.750453 (+ 4514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:50.750463 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:50.750480 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:50.751001 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:50.751459 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:50.751462 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:50.751464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:50.751681 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:50.752389 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:50.752396 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:50.752780 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 01:37:50.753048 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 01:37:50.753502 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":323,"threads_started":1}
I20260811 01:37:50.756547 21623 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44115
I20260811 01:37:50.756942 21623 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:37:50.757966 21623 heartbeater.cc:511] Master 127.17.132.62:44115 requested a full tablet report, sending...
I20260811 01:37:50.759678 21274 ts_manager.cc:194] Registered new tserver with Master: fe9ac5b15aca4b988dbda0c4384faf73 (127.17.132.2:35305)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
I20260811 01:37:50.760627 21274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:44725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:50.793323 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:51.148864 21629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:51.149201 21629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:51.149405 21629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:51.157404 21629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:51.157539 21629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:51.157727 21629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:51.168815 21629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:51.170322 21629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:51.171753 21629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:51.187150 21634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:51.187134 21637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:51.187089 21635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:51.188565 21629 server_base.cc:1034] running on GCE node
I20260811 01:37:51.189329 21629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:51.190546 21629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:51.191804 21629 hybrid_clock.cc:648] HybridClock initialized: now 1786412271191744 us; error 60 us; skew 500 ppm
I20260811 01:37:51.192154 21629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:51.195592 21629 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:51.197275 21629 webserver.cc:460] Webserver started at http://127.17.132.3:46789/ using document root <none> and password file <none>
I20260811 01:37:51.198143 21629 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:51.198298 21629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:51.198642 21629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:51.202049 21479 heartbeater.cc:503] Master 127.17.132.62:44115 was elected leader, sending a full tablet report...
I20260811 01:37:51.202088 21629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "8ce9f26757204548ad2c387e7df64b7a"
format_stamp: "Formatted at 2026-08-11 01:37:51 on dist-test-slave-0kls"
server_key: "6127034882306d86eb5cf94638a51cb9"
server_key_iv: "1b039b1e480646b702e878f97bef9bf7"
server_key_version: "encryptionkey@0"
I20260811 01:37:51.203189 21629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "8ce9f26757204548ad2c387e7df64b7a"
format_stamp: "Formatted at 2026-08-11 01:37:51 on dist-test-slave-0kls"
server_key: "6127034882306d86eb5cf94638a51cb9"
server_key_iv: "1b039b1e480646b702e878f97bef9bf7"
server_key_version: "encryptionkey@0"
I20260811 01:37:51.210613 21629 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:37:51.214784 21645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:51.216637 21629 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:37:51.216887 21629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "8ce9f26757204548ad2c387e7df64b7a"
format_stamp: "Formatted at 2026-08-11 01:37:51 on dist-test-slave-0kls"
server_key: "6127034882306d86eb5cf94638a51cb9"
server_key_iv: "1b039b1e480646b702e878f97bef9bf7"
server_key_version: "encryptionkey@0"
I20260811 01:37:51.217152 21629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:51.239781 21629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:51.244714 21629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:51.245074 21629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:51.246255 21629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:51.247768 21629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:51.247884 21629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:51.248044 21629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:51.248118 21629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:51.286130 21629 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:42245
I20260811 01:37:51.286224 21768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:42245 every 8 connection(s)
I20260811 01:37:51.287767 21629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:51.289309 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21629
I20260811 01:37:51.289565 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:51.290169 17936 external_mini_cluster.cc:1428] Setting key 4b0d2962a81a47acc176d36c128f3693
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:51.311882 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.291261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:56239 (local address 127.17.132.62:44115)
0811 01:37:51.291832 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:51.291837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:51.293032 (+ 1195us) server_negotiation.cc:407] Connection header received
0811 01:37:51.295222 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:51.295227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:51.295327 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:51.295456 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:51.297138 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.298006 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.299682 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.300105 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.300260 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.304245 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:51.304250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:51.304254 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:51.304302 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:51.308199 (+ 3897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.309194 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.309201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.309205 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.309386 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.309930 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.309942 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.309944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.310243 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:51.310426 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:51.311216 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 01:37:51.311469 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":263,"threads_started":1}
I20260811 01:37:51.313014 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.291894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44115 (local address 127.17.132.3:56239)
0811 01:37:51.292813 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:51.292859 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:51.294908 (+ 2049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:51.295732 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:51.295742 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:51.296318 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:51.296942 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:51.296961 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.298189 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.298193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:51.299504 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:51.299518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.300380 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.300389 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:51.300658 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.301432 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:51.301457 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:51.303955 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:51.308433 (+ 4478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:51.308442 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:51.308460 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:51.309045 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:51.309519 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:51.309524 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:51.309528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:51.309748 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:51.310390 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:51.310400 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:51.310800 (+ 400us) client_negotiation.cc:769] Sending connection context
0811 01:37:51.311097 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 01:37:51.311720 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":339,"threads_started":1}
I20260811 01:37:51.314779 21769 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44115
I20260811 01:37:51.315191 21769 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:51.316110 21769 heartbeater.cc:511] Master 127.17.132.62:44115 requested a full tablet report, sending...
I20260811 01:37:51.318024 21274 ts_manager.cc:194] Registered new tserver with Master: 8ce9f26757204548ad2c387e7df64b7a (127.17.132.3:42245)
I20260811 01:37:51.319288 21274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:56239
I20260811 01:37:51.320289 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:51.382658 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.365418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59918 (local address 127.17.132.62:44115)
0811 01:37:51.365623 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:51.365628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:51.366261 (+ 633us) server_negotiation.cc:407] Connection header received
0811 01:37:51.366413 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:51.366418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:51.366492 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:51.366588 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:51.368458 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.369265 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.370671 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.371093 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.371237 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.375895 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:51.375902 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:51.375905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:51.375951 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:51.378957 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.379860 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.379865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.379868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.380020 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.380745 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.380752 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.380754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.381213 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:51.381619 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:51.382045 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 01:37:51.382327 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 01:37:51.383339 21273 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59918
I20260811 01:37:51.385313 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21338
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:51.403503 21782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.386669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.17.132.1:39025)
0811 01:37:51.387870 (+ 1201us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:51.387878 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:51.387903 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:37:51.387980 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:51.387986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:51.388202 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:51.388396 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:51.389688 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.390897 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.392167 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.392794 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.392943 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.397258 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:51.397272 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:51.397288 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:51.397325 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:51.400356 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.401143 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.401152 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.401155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.401296 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.401737 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.401742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.401744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.402217 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:51.402554 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:51.402859 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 01:37:51.403142 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1054,"thread_start_us":835,"threads_started":1}
W20260811 01:37:51.404862 21474 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51900
W20260811 01:37:51.406153 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21338: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:51.406383 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21338
I20260811 01:37:51.427706 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21485
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:51.445077 21783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.428727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56724 (local address 127.17.132.2:35305)
0811 01:37:51.429266 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:51.429273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:51.429299 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:37:51.429364 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:51.429370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:51.429579 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:51.429762 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:51.431132 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.432145 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.433449 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.434099 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.434243 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.438689 (+ 4446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:51.438704 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:51.438720 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:51.438761 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:51.441937 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.442745 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.442755 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.442758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.442897 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.443300 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.443304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.443308 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.443691 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:51.444030 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:51.444390 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 01:37:51.444702 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":268,"threads_started":1}
W20260811 01:37:51.446575 21617 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56724
W20260811 01:37:51.447778 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21485: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:51.447994 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21485
I20260811 01:37:51.468271 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21629
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412271, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:51.487097 21784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:51.469355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.17.132.3:42245)
0811 01:37:51.470085 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:51.470093 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:51.470124 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:37:51.470207 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:51.470213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:51.470432 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:51.470642 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:51.472092 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.473177 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.474543 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:51.475179 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:51.475329 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:51.480334 (+ 5005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:51.480351 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:51.480368 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:51.480415 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:51.483514 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.484331 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.484340 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.484343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.484510 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:51.484882 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:51.484889 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:51.484891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:51.485440 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:51.485740 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:51.486408 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 01:37:51.486695 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":340,"threads_started":1}
W20260811 01:37:51.488957 21764 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38432
W20260811 01:37:51.490588 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21629: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:37:51.490770 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21629
I20260811 01:37:51.511698 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21240
I20260811 01:37:51.512993 21304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:51.620483 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21240
2026-08-11T01:37:51Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4094 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21788](info): set up 2 sockets
Aug 11 01:37:51 dist-test-slave-0kls krb5kdc[21788](info): commencing operation
krb5kdc: starting...
W20260811 01:37:52.800328 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.008s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:52 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:53.057855 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42875
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:42875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:53.401343 21802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:53.401669 21802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:53.401767 21802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:53.409348 21802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:53.409477 21802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:53.409524 21802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:53.409576 21802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:53.409622 21802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:53.419837 21802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:42875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:53.421190 21802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:53.422559 21802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:53.435319 21810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:53.435400 21808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:53.435397 21807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:53.436342 21802 server_base.cc:1034] running on GCE node
I20260811 01:37:53.437156 21802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:53.438843 21802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:53.440152 21802 hybrid_clock.cc:648] HybridClock initialized: now 1786412273440095 us; error 35 us; skew 500 ppm
I20260811 01:37:53.440627 21802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:53 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412273, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:53.444295 21802 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:53.446228 21802 webserver.cc:460] Webserver started at http://127.17.132.62:40825/ using document root <none> and password file <none>
I20260811 01:37:53.447011 21802 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:53.447125 21802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:53.447404 21802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:53.450891 21802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "5687f656f6b44ff98495ff8e55450eee"
format_stamp: "Formatted at 2026-08-11 01:37:53 on dist-test-slave-0kls"
server_key: "10db60ec21ae9d7aeb4ae3524708e305"
server_key_iv: "92430ced4fb0bce019c3673f13e7e465"
server_key_version: "encryptionkey@0"
I20260811 01:37:53.451825 21802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "5687f656f6b44ff98495ff8e55450eee"
format_stamp: "Formatted at 2026-08-11 01:37:53 on dist-test-slave-0kls"
server_key: "10db60ec21ae9d7aeb4ae3524708e305"
server_key_iv: "92430ced4fb0bce019c3673f13e7e465"
server_key_version: "encryptionkey@0"
I20260811 01:37:53.458601 21802 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:37:53.463213 21818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:53.464884 21802 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:37:53.465128 21802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "5687f656f6b44ff98495ff8e55450eee"
format_stamp: "Formatted at 2026-08-11 01:37:53 on dist-test-slave-0kls"
server_key: "10db60ec21ae9d7aeb4ae3524708e305"
server_key_iv: "92430ced4fb0bce019c3673f13e7e465"
server_key_version: "encryptionkey@0"
I20260811 01:37:53.465334 21802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:53.483673 21802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:53.488732 21802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:53.489063 21802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:53.509953 21802 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:42875
I20260811 01:37:53.510015 21872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:42875 every 8 connection(s)
I20260811 01:37:53.511584 21802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:53.512856 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21802
I20260811 01:37:53.513098 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:53.514032 17936 external_mini_cluster.cc:1428] Setting key 3af14ac60b84b750c160c9786d22c92f
I20260811 01:37:53.517477 21873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:37:53 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:53.532478 21873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee: Bootstrap starting.
I20260811 01:37:53.537180 21873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:53.538658 21873 log.cc:824] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:53.542428 21873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee: No bootstrap required, opened a new log
I20260811 01:37:53.542446 21877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:53.516309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55740 (local address 127.17.132.62:42875)
0811 01:37:53.517254 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:53.517271 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:53.517326 (+ 55us) server_negotiation.cc:407] Connection header received
0811 01:37:53.519911 (+ 2585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:53.519945 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:53.520524 (+ 579us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:53.521028 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:53.522706 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:53.524928 (+ 2222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:53.526458 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:53.527585 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:53.527796 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:53.532528 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:53.532541 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:53.532565 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:53.532624 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:53.537116 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:53.538146 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:53.538157 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:53.538171 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:53.538439 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:53.539016 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:53.539021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:53.539023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:53.539963 (+ 940us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:53.540320 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:53.540815 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 01:37:53.541245 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":437,"threads_started":1}
I20260811 01:37:53.551198 21873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } }
I20260811 01:37:53.551666 21873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:53.551795 21873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5687f656f6b44ff98495ff8e55450eee, State: Initialized, Role: FOLLOWER
I20260811 01:37:53.552387 21873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } }
I20260811 01:37:53.552650 21873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:53.552807 21873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:53.553000 21873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:53.555697 21873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } }
I20260811 01:37:53.556279 21873 leader_election.cc:302] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5687f656f6b44ff98495ff8e55450eee; no voters:
I20260811 01:37:53.556910 21873 leader_election.cc:288] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:53.557098 21879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:53.557890 21879 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [term 1 LEADER]: Becoming Leader. State: Replica: 5687f656f6b44ff98495ff8e55450eee, State: Running, Role: LEADER
I20260811 01:37:53.558499 21879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } }
I20260811 01:37:53.559509 21873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:53.562287 21880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5687f656f6b44ff98495ff8e55450eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } } }
I20260811 01:37:53.562397 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5687f656f6b44ff98495ff8e55450eee. Latest consensus state: current_term: 1 leader_uuid: "5687f656f6b44ff98495ff8e55450eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5687f656f6b44ff98495ff8e55450eee" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42875 } } }
I20260811 01:37:53.562749 21880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:53.562799 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:53.564963 21887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:53.570824 21887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:53.580902 21887 catalog_manager.cc:1347] Generated new cluster ID: 157785a0b41744daaa1cbad5677bb12f
I20260811 01:37:53.581121 21887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:53.595635 21887 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:53.597224 21887 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:53.604779 21887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5687f656f6b44ff98495ff8e55450eee: Generated new TSK 0
I20260811 01:37:53.605770 21887 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:53.679211 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:54.053316 21902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:54.053646 21902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:54.053746 21902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:54.061687 21902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:54.061884 21902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:54.062062 21902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:54.072605 21902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:54.074092 21902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:54.075497 21902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:54.089831 21907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:54.089866 21910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:54.089916 21908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:54.095758 21902 server_base.cc:1034] running on GCE node
I20260811 01:37:54.096581 21902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:54.097723 21902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:54.099014 21902 hybrid_clock.cc:648] HybridClock initialized: now 1786412274098961 us; error 47 us; skew 500 ppm
I20260811 01:37:54.099417 21902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:54 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412274, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:54.103006 21902 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:54.104842 21902 webserver.cc:460] Webserver started at http://127.17.132.1:39857/ using document root <none> and password file <none>
I20260811 01:37:54.105664 21902 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:54.105836 21902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:54.106207 21902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:54.109447 21902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "e07946416f4f40a9a5b65d086f612c74"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "2d4c162aa9aa20d9ecbcad7c6c1a3b43"
server_key_iv: "41786fd95ef6cb7f28341d5b761770fd"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.110436 21902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "e07946416f4f40a9a5b65d086f612c74"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "2d4c162aa9aa20d9ecbcad7c6c1a3b43"
server_key_iv: "41786fd95ef6cb7f28341d5b761770fd"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.116189 21902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:37:54.120155 21920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.121735 21902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:37:54.121987 21902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e07946416f4f40a9a5b65d086f612c74"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "2d4c162aa9aa20d9ecbcad7c6c1a3b43"
server_key_iv: "41786fd95ef6cb7f28341d5b761770fd"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.122217 21902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:54.144657 21902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:54.149587 21902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:54.150015 21902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:54.151196 21902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:54.152918 21902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:54.153021 21902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.153162 21902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:54.153232 21902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.191250 21902 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:33215
I20260811 01:37:54.191370 22040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:33215 every 8 connection(s)
I20260811 01:37:54.192711 21902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:54.199131 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 21902
I20260811 01:37:54.199385 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:54.200078 17936 external_mini_cluster.cc:1428] Setting key 07663c0083800af3c696875646301169
Aug 11 01:37:54 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412274, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:54.216169 22043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:54.195480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:54773 (local address 127.17.132.62:42875)
0811 01:37:54.196039 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:54.196045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:54.196985 (+ 940us) server_negotiation.cc:407] Connection header received
0811 01:37:54.199056 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:54.199064 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:54.199168 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:54.199321 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:54.201394 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.202374 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.204066 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.204842 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.205004 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:54.209099 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:54.209109 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:54.209117 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:54.209169 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:54.212312 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:54.213488 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:54.213492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:54.213495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:54.213629 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:54.214265 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:54.214268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:54.214271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:54.214563 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:54.214683 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:54.215707 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0811 01:37:54.215902 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":256,"threads_started":1}
I20260811 01:37:54.217929 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:54.196012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42875 (local address 127.17.132.1:54773)
0811 01:37:54.196796 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:54.196838 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:54.198729 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:54.199664 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:54.199673 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:54.200406 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:54.201205 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:54.201233 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.202545 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.202551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:54.203884 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:54.203898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.205099 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.205104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:54.205315 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:54.206224 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:54.206249 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:54.208787 (+ 2538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:54.212525 (+ 3738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:54.212540 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:54.212564 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:54.213334 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:54.213758 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:54.213766 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:54.213773 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:54.214138 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:54.214717 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:54.214729 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:54.215255 (+ 526us) client_negotiation.cc:769] Sending connection context
0811 01:37:54.215591 (+ 336us) client_negotiation.cc:240] Negotiation successful
0811 01:37:54.216252 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":284,"threads_started":1}
I20260811 01:37:54.219732 22041 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42875
I20260811 01:37:54.220117 22041 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:54.221073 22041 heartbeater.cc:511] Master 127.17.132.62:42875 requested a full tablet report, sending...
I20260811 01:37:54.223433 21838 ts_manager.cc:194] Registered new tserver with Master: e07946416f4f40a9a5b65d086f612c74 (127.17.132.1:33215)
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:54.225046 21838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:54773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:54.257858 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:54.616026 22047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:54.616438 22047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:54.616617 22047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:54.624387 22047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:54.624584 22047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:54.624773 22047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:54.635504 22047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:54.636940 22047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:54.638433 22047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:54.652699 22052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:54.652611 22053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:54.652732 22055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:54.654093 22047 server_base.cc:1034] running on GCE node
I20260811 01:37:54.654850 22047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:54.655966 22047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:54.657229 22047 hybrid_clock.cc:648] HybridClock initialized: now 1786412274657168 us; error 60 us; skew 500 ppm
I20260811 01:37:54.657577 22047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:54 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412274, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:54.661042 22047 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:54.662774 22047 webserver.cc:460] Webserver started at http://127.17.132.2:42763/ using document root <none> and password file <none>
I20260811 01:37:54.663544 22047 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:54.663703 22047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:54.664041 22047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:54.667268 22047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "a8682a1d709e4159bdf9f0c733c46ffa"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "1695e09f5fd0908d332c300cb1bbbdd4"
server_key_iv: "305366a403e77b315b6d9bc7a07cff17"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.668107 22047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "a8682a1d709e4159bdf9f0c733c46ffa"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "1695e09f5fd0908d332c300cb1bbbdd4"
server_key_iv: "305366a403e77b315b6d9bc7a07cff17"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.673955 22047 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:37:54.678157 22063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.679862 22047 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:37:54.680096 22047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "a8682a1d709e4159bdf9f0c733c46ffa"
format_stamp: "Formatted at 2026-08-11 01:37:54 on dist-test-slave-0kls"
server_key: "1695e09f5fd0908d332c300cb1bbbdd4"
server_key_iv: "305366a403e77b315b6d9bc7a07cff17"
server_key_version: "encryptionkey@0"
I20260811 01:37:54.680349 22047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:54.703857 22047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:54.708554 22047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:54.708899 22047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:54.710050 22047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:54.711547 22047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:54.711668 22047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.711831 22047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:54.711908 22047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:54.748039 22047 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:45847
I20260811 01:37:54.748142 22184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:45847 every 8 connection(s)
I20260811 01:37:54.749449 22047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:54.754295 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22047
I20260811 01:37:54.754498 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:54.755079 17936 external_mini_cluster.cc:1428] Setting key 3cbfcab575fabaa719061a269b9197fe
Aug 11 01:37:54 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412274, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:54.777078 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:54.752253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:47439 (local address 127.17.132.62:42875)
0811 01:37:54.752722 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:54.752727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:54.753586 (+ 859us) server_negotiation.cc:407] Connection header received
0811 01:37:54.756202 (+ 2616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:54.756208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:54.756302 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:54.756398 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:54.759410 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.760237 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.763047 (+ 2810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.763550 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.763674 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:54.768898 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:54.768904 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:54.768908 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:54.768949 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:54.772751 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:54.774039 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:54.774048 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:54.774054 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:54.774286 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:54.774826 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:54.774834 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:54.774839 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:54.775278 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:54.775442 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:54.776262 (+ 820us) server_negotiation.cc:299] Negotiation successful
0811 01:37:54.776555 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":257,"threads_started":1}
I20260811 01:37:54.777777 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:54.752669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42875 (local address 127.17.132.2:47439)
0811 01:37:54.753418 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:54.753457 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:54.755900 (+ 2443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:54.757201 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:54.757211 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:54.758149 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:54.759094 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:54.759128 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.760475 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.760482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:54.762827 (+ 2345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:54.762851 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:54.763841 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:54.763851 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:54.764235 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:54.765161 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:54.765198 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:54.768549 (+ 3351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:54.772991 (+ 4442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:54.773005 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:54.773030 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:54.773865 (+ 835us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:54.774429 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:54.774433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:54.774435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:54.774658 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:54.775413 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:54.775420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:54.775822 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 01:37:54.776075 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 01:37:54.776528 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":292,"threads_started":1}
I20260811 01:37:54.779498 22185 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42875
I20260811 01:37:54.779904 22185 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:54.780929 22185 heartbeater.cc:511] Master 127.17.132.62:42875 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:37:54.783079 21838 ts_manager.cc:194] Registered new tserver with Master: a8682a1d709e4159bdf9f0c733c46ffa (127.17.132.2:45847)
I20260811 01:37:54.784037 21838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:47439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:54.817582 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:55.177893 22191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:55.178233 22191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:55.178447 22191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:55.186448 22191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:55.186581 22191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:55.186784 22191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:55.197748 22191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:55.199206 22191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:55.200628 22191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:55.215247 22199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:55.215344 22197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:55.215296 22196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:55.216348 22191 server_base.cc:1034] running on GCE node
I20260811 01:37:55.217101 22191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:55.218257 22191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:55.219518 22191 hybrid_clock.cc:648] HybridClock initialized: now 1786412275219472 us; error 34 us; skew 500 ppm
I20260811 01:37:55.219924 22191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:55.228225 22191 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:55.228485 22041 heartbeater.cc:503] Master 127.17.132.62:42875 was elected leader, sending a full tablet report...
I20260811 01:37:55.230376 22191 webserver.cc:460] Webserver started at http://127.17.132.3:44695/ using document root <none> and password file <none>
I20260811 01:37:55.231128 22191 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:55.231274 22191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:55.231616 22191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:55.234874 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "ad45f89fc0f24ce0a72e65fde2508737"
format_stamp: "Formatted at 2026-08-11 01:37:55 on dist-test-slave-0kls"
server_key: "9c939f9c74c716a4cb97d649eb9f2d6d"
server_key_iv: "585bf04c20aa2df05c5882df96783824"
server_key_version: "encryptionkey@0"
I20260811 01:37:55.235736 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "ad45f89fc0f24ce0a72e65fde2508737"
format_stamp: "Formatted at 2026-08-11 01:37:55 on dist-test-slave-0kls"
server_key: "9c939f9c74c716a4cb97d649eb9f2d6d"
server_key_iv: "585bf04c20aa2df05c5882df96783824"
server_key_version: "encryptionkey@0"
I20260811 01:37:55.241586 22191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:37:55.245602 22207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:55.247210 22191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:55.247408 22191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "ad45f89fc0f24ce0a72e65fde2508737"
format_stamp: "Formatted at 2026-08-11 01:37:55 on dist-test-slave-0kls"
server_key: "9c939f9c74c716a4cb97d649eb9f2d6d"
server_key_iv: "585bf04c20aa2df05c5882df96783824"
server_key_version: "encryptionkey@0"
I20260811 01:37:55.247625 22191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:55.262148 22191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:55.266821 22191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:55.267146 22191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:55.268349 22191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:55.270041 22191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:55.270169 22191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:55.270301 22191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:55.270367 22191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:55.309648 22191 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:40467
I20260811 01:37:55.309803 22331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:40467 every 8 connection(s)
I20260811 01:37:55.311070 22191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:55.314317 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22191
I20260811 01:37:55.314509 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:55.315125 17936 external_mini_cluster.cc:1428] Setting key b6b9b5b65eed3c8ee1bdfc63c1b50747
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:55.334323 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.314082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40503 (local address 127.17.132.62:42875)
0811 01:37:55.314651 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.314657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.315915 (+ 1258us) server_negotiation.cc:407] Connection header received
0811 01:37:55.318350 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.318355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.318461 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.318588 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.320397 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.321189 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.322947 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.323469 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.323618 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.327601 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.327607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.327610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.327645 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.330772 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.331886 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.331890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.331892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.332018 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.332551 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.332555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.332557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.332853 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.332975 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.333842 (+ 867us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.334039 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":368,"threads_started":1}
I20260811 01:37:55.335417 22335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.314621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42875 (local address 127.17.132.3:40503)
0811 01:37:55.315653 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:55.315724 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:55.318010 (+ 2286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:55.318913 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:55.318924 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:55.319558 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:55.320212 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:55.320231 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.321394 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.321398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:55.322788 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:55.322802 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.323746 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.323752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:55.323993 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.324796 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:55.324822 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:55.327367 (+ 2545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:55.330969 (+ 3602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:55.330982 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:55.331003 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:55.331744 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:55.332169 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:55.332173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:55.332176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:55.332412 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:55.333003 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:55.333010 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:55.333417 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 01:37:55.333675 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 01:37:55.334207 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":466,"threads_started":1}
I20260811 01:37:55.337869 22332 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42875
I20260811 01:37:55.338348 22332 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:55.339373 22332 heartbeater.cc:511] Master 127.17.132.62:42875 requested a full tablet report, sending...
I20260811 01:37:55.341773 21838 ts_manager.cc:194] Registered new tserver with Master: ad45f89fc0f24ce0a72e65fde2508737 (127.17.132.3:40467)
I20260811 01:37:55.343088 21838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:40503
I20260811 01:37:55.344833 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:37:55.405083 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.388421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55500 (local address 127.17.132.1:33215)
0811 01:37:55.389129 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.389137 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.389167 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:37:55.389238 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.389245 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.389469 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.389755 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.391690 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.392760 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.394258 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.394887 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.395004 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.399319 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.399334 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.399352 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.399394 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.402427 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.403206 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.403214 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.403217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.403345 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.403694 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.403697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.403699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.404056 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.404308 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.404586 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.404794 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":385,"threads_started":1}
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:55.424467 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.410378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55756 (local address 127.17.132.62:42875)
0811 01:37:55.410616 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.410622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.410766 (+ 144us) server_negotiation.cc:407] Connection header received
0811 01:37:55.410906 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.410910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.410991 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.411074 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.412367 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.413111 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.414542 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.414960 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.415060 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.419267 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.419274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.419278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.419320 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.422088 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.422736 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.422740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.422742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.422863 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.423170 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.423173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.423175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.423494 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.423694 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.424038 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.424232 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 01:37:55.425185 21838 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55756
I20260811 01:37:55.426412 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21902
I20260811 01:37:55.441565 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.427570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55510 (local address 127.17.132.1:33215)
0811 01:37:55.427807 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.427811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.427908 (+ 97us) server_negotiation.cc:407] Connection header received
0811 01:37:55.428035 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.428038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.428137 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.428223 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.429644 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.430517 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.431874 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.432300 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.432417 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.435269 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.435274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.435278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.435318 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.438325 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.439220 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.439225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.439227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.439376 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.439897 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.439902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.439904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.440232 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.440442 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.440912 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.441116 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:37:55.442358 22036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:55.536834 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21902
I20260811 01:37:55.559669 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22047
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:37:55.578079 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.560773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48386 (local address 127.17.132.2:45847)
0811 01:37:55.561334 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.561342 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.561368 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:37:55.561438 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.561445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.561684 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.561898 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.563156 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.564145 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.565450 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.566108 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.566257 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.571142 (+ 4885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.571162 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.571179 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.571227 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.574831 (+ 3604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.575725 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.575735 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.575738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.575908 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.576319 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.576322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.576324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.576751 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.577012 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.577326 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.577561 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":280,"threads_started":1}
I20260811 01:37:55.579507 22180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:55.665633 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22047
I20260811 01:37:55.685992 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22191
Aug 11 01:37:55 dist-test-slave-0kls krb5kdc[21788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:37:55.703922 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:55.687012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.17.132.3:40467)
0811 01:37:55.687686 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:55.687693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:55.687726 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:37:55.687790 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:55.687796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:55.688019 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:55.688222 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:55.689641 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.690873 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.692363 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:55.692988 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:55.693149 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:55.698044 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:55.698061 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:55.698078 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:55.698123 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:55.700964 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.701754 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.701762 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.701764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.701966 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:55.702353 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:55.702356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:55.702358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:55.702735 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:55.702991 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:55.703252 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 01:37:55.703486 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":346,"threads_started":1}
I20260811 01:37:55.705407 22327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:55.791914 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22191
I20260811 01:37:55.812594 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 21802
I20260811 01:37:55.813979 21868 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:55.922752 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 21802
2026-08-11T01:37:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4299 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:56 dist-test-slave-0kls krb5kdc[22353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:56 dist-test-slave-0kls krb5kdc[22353](info): set up 2 sockets
Aug 11 01:37:56 dist-test-slave-0kls krb5kdc[22353](info): commencing operation
krb5kdc: starting...
W20260811 01:37:57.098318 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:37:57 dist-test-slave-0kls krb5kdc[22353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:37:57.363644 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35039
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:35039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:57.714195 22366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:57.714551 22366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:57.714736 22366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:57.722193 22366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:57.722314 22366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:57.722419 22366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:57.722527 22366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:57.722612 22366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:57.733464 22366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:35039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:57.734896 22366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:57.736315 22366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:57.748443 22372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:57.748504 22375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:57.748528 22371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:57.749122 22366 server_base.cc:1034] running on GCE node
I20260811 01:37:57.750072 22366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:57.751585 22366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:57.752859 22366 hybrid_clock.cc:648] HybridClock initialized: now 1786412277752808 us; error 40 us; skew 500 ppm
I20260811 01:37:57.753276 22366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:57 dist-test-slave-0kls krb5kdc[22353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:57.756650 22366 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:37:57.758013 22366 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:57.758155 22366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:57.758507 22366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:57.761615 22366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "a9b5097b5d0d43e2aac13d389aa40b58"
format_stamp: "Formatted at 2026-08-11 01:37:57 on dist-test-slave-0kls"
server_key: "f07daf8982d935c082d5f25df31e914a"
server_key_iv: "47401708ed333605807fa6b0252874b7"
server_key_version: "encryptionkey@0"
I20260811 01:37:57.762526 22366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "a9b5097b5d0d43e2aac13d389aa40b58"
format_stamp: "Formatted at 2026-08-11 01:37:57 on dist-test-slave-0kls"
server_key: "f07daf8982d935c082d5f25df31e914a"
server_key_iv: "47401708ed333605807fa6b0252874b7"
server_key_version: "encryptionkey@0"
I20260811 01:37:57.767773 22366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 01:37:57.771299 22382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:57.772682 22366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:37:57.772889 22366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "a9b5097b5d0d43e2aac13d389aa40b58"
format_stamp: "Formatted at 2026-08-11 01:37:57 on dist-test-slave-0kls"
server_key: "f07daf8982d935c082d5f25df31e914a"
server_key_iv: "47401708ed333605807fa6b0252874b7"
server_key_version: "encryptionkey@0"
I20260811 01:37:57.773125 22366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:57.809199 22366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:57.814248 22366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:57.814554 22366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:57.834151 22366 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:35039
I20260811 01:37:57.834132 22436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:35039 every 8 connection(s)
I20260811 01:37:57.835129 22366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:57.838959 22437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:57.840608 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22366
I20260811 01:37:57.840842 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:37:57.841737 17936 external_mini_cluster.cc:1428] Setting key da5785a3a8f31feaa8ffd877d934bb60
I20260811 01:37:57.853978 22437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: Bootstrap starting.
I20260811 01:37:57.858992 22437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: Neither blocks nor log segments found. Creating new log.
Aug 11 01:37:57 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:57.860423 22437 log.cc:824] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:57.864588 22437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: No bootstrap required, opened a new log
I20260811 01:37:57.870529 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:57.844146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.17.132.62:35039)
0811 01:37:57.845062 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:57.845078 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:57.845137 (+ 59us) server_negotiation.cc:407] Connection header received
0811 01:37:57.847112 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:57.847141 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:57.847657 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:57.848033 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:57.850469 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:57.851899 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:57.853948 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:57.854742 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:57.854893 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:57.860401 (+ 5508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:57.860422 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:57.860447 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:57.860522 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:57.864815 (+ 4293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:57.865692 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:57.865702 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:57.865713 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:57.865980 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:57.866506 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:57.866512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:57.866516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:57.867363 (+ 847us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:57.867697 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:57.868396 (+ 699us) server_negotiation.cc:299] Negotiation successful
0811 01:37:57.868925 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":428,"threads_started":1}
I20260811 01:37:57.875171 22437 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } }
I20260811 01:37:57.875571 22437 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:57.875746 22437 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b5097b5d0d43e2aac13d389aa40b58, State: Initialized, Role: FOLLOWER
I20260811 01:37:57.876534 22437 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } }
I20260811 01:37:57.876820 22437 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:37:57.876968 22437 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:37:57.877187 22437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:57.879786 22437 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } }
I20260811 01:37:57.880381 22437 leader_election.cc:302] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9b5097b5d0d43e2aac13d389aa40b58; no voters:
I20260811 01:37:57.881099 22437 leader_election.cc:288] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:37:57.881349 22443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:57.882862 22443 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [term 1 LEADER]: Becoming Leader. State: Replica: a9b5097b5d0d43e2aac13d389aa40b58, State: Running, Role: LEADER
I20260811 01:37:57.883442 22443 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } }
I20260811 01:37:57.883605 22437 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:57.886682 22445 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9b5097b5d0d43e2aac13d389aa40b58. Latest consensus state: current_term: 1 leader_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } } }
I20260811 01:37:57.886658 22444 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9b5097b5d0d43e2aac13d389aa40b58" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35039 } } }
I20260811 01:37:57.887192 22445 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:57.887188 22444 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:57.888151 22451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:57.894419 22451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:37:57.917019 22451 catalog_manager.cc:1347] Generated new cluster ID: 8d6e388bb5a84038a072c25a22ffafa2
I20260811 01:37:57.917171 22451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:57.948113 22451 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:57.949575 22451 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:57.957374 22451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: Generated new TSK 0
I20260811 01:37:57.958415 22451 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:37:58.037169 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:58.430658 22466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:58.430967 22466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:58.431070 22466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:58.438552 22466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:58.438696 22466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:58.438817 22466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:37:58.449136 22466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:58.450565 22466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:58.451912 22466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:58.466183 22474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:58.466289 22472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:58.466234 22471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:58.471762 22466 server_base.cc:1034] running on GCE node
I20260811 01:37:58.472520 22466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:58.473649 22466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:58.474936 22466 hybrid_clock.cc:648] HybridClock initialized: now 1786412278474888 us; error 50 us; skew 500 ppm
I20260811 01:37:58.475379 22466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:58 dist-test-slave-0kls krb5kdc[22353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412278, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:58.479033 22466 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:37:58.480430 22466 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:58.480540 22466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:58.480842 22466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:58.484318 22466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "db7f315c36234c1e953db291ec83101f"
format_stamp: "Formatted at 2026-08-11 01:37:58 on dist-test-slave-0kls"
server_key: "79d889508559cfe9f6b10111e04ea2b4"
server_key_iv: "1de91fee8bffc629233ff59718d8db3d"
server_key_version: "encryptionkey@0"
I20260811 01:37:58.485261 22466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "db7f315c36234c1e953db291ec83101f"
format_stamp: "Formatted at 2026-08-11 01:37:58 on dist-test-slave-0kls"
server_key: "79d889508559cfe9f6b10111e04ea2b4"
server_key_iv: "1de91fee8bffc629233ff59718d8db3d"
server_key_version: "encryptionkey@0"
I20260811 01:37:58.491009 22466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 01:37:58.495020 22481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:58.496801 22466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:37:58.497022 22466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "db7f315c36234c1e953db291ec83101f"
format_stamp: "Formatted at 2026-08-11 01:37:58 on dist-test-slave-0kls"
server_key: "79d889508559cfe9f6b10111e04ea2b4"
server_key_iv: "1de91fee8bffc629233ff59718d8db3d"
server_key_version: "encryptionkey@0"
I20260811 01:37:58.497268 22466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:58.526870 22466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:58.531596 22466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:58.531908 22466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:58.533006 22466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:58.534577 22466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:58.534672 22466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:58.534842 22466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:58.534936 22466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:58.571250 22466 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:44567
I20260811 01:37:58.571349 22602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:44567 every 8 connection(s)
I20260811 01:37:58.572217 22466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:37:58.577962 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22466
I20260811 01:37:58.578219 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:37:58.578867 17936 external_mini_cluster.cc:1428] Setting key 53f2a37aaf73e5c3dc9b2b3bca64889e
Aug 11 01:37:58 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412278, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:58.594493 22605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:58.574834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:56693 (local address 127.17.132.62:35039)
0811 01:37:58.575278 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:58.575283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:58.576412 (+ 1129us) server_negotiation.cc:407] Connection header received
0811 01:37:58.578577 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:58.578582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:58.578685 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:58.578823 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:58.580894 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:58.581650 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:58.583340 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:58.583887 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:58.584047 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:58.588266 (+ 4219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:58.588278 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:58.588281 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:58.588316 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:58.591081 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:58.591938 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:58.591949 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:58.591952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:58.592078 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:58.592554 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:58.592563 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:58.592565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:58.592861 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:58.593056 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:58.593872 (+ 816us) server_negotiation.cc:299] Negotiation successful
0811 01:37:58.594119 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":225,"threads_started":1}
I20260811 01:37:58.595574 22606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:58.575365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35039 (local address 127.17.132.1:56693)
0811 01:37:58.576194 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:58.576242 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:58.578222 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:58.579084 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:58.579094 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:58.579812 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:58.580644 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:58.580674 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:58.581848 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:58.581854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:58.583160 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:58.583174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:58.584142 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:58.584151 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:58.584406 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:58.585303 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:58.585327 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:58.587986 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:58.591271 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:58.591281 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:58.591302 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:58.591787 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:58.592207 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:58.592212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:58.592216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:58.592420 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:58.593002 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:58.593013 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:58.593415 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 01:37:58.593720 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 01:37:58.594338 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":377,"threads_started":1}
I20260811 01:37:58.597385 22603 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35039
I20260811 01:37:58.597807 22603 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:58.598737 22603 heartbeater.cc:511] Master 127.17.132.62:35039 requested a full tablet report, sending...
I20260811 01:37:58.601890 22401 ts_manager.cc:194] Registered new tserver with Master: db7f315c36234c1e953db291ec83101f (127.17.132.1:44567)
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:37:58.603750 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:56693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:37:58.637506 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:58.999117 22609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:58.999487 22609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:58.999670 22609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:59.008231 22609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:59.008404 22609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:59.008611 22609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:37:59.018929 22609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:59.020555 22609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:59.022126 22609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:59.036623 22618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:59.036695 22615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:59.036716 22616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:59.037638 22609 server_base.cc:1034] running on GCE node
I20260811 01:37:59.038362 22609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:59.039440 22609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:59.040695 22609 hybrid_clock.cc:648] HybridClock initialized: now 1786412279040650 us; error 73 us; skew 500 ppm
I20260811 01:37:59.041052 22609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:59 dist-test-slave-0kls krb5kdc[22353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412279, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:59.044736 22609 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:37:59.046100 22609 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:59.046276 22609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:59.046644 22609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:59.050283 22609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "e1dee15f19ad4644b9d3dcac49ca5610"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "741b556fcd7528206eb63922bfa2397c"
server_key_iv: "bcd5e831e5da45f8529cd43346c766c2"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.051278 22609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "e1dee15f19ad4644b9d3dcac49ca5610"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "741b556fcd7528206eb63922bfa2397c"
server_key_iv: "bcd5e831e5da45f8529cd43346c766c2"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.057050 22609 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:37:59.061085 22624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.062654 22609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:59.062849 22609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e1dee15f19ad4644b9d3dcac49ca5610"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "741b556fcd7528206eb63922bfa2397c"
server_key_iv: "bcd5e831e5da45f8529cd43346c766c2"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.063088 22609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:59.081636 22609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:59.088075 22609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:59.088481 22609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:59.089653 22609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:59.091223 22609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:59.091360 22609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.091506 22609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:59.091609 22609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.129632 22609 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:34483
I20260811 01:37:59.129726 22747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:34483 every 8 connection(s)
I20260811 01:37:59.130568 22609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:37:59.133538 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22609
I20260811 01:37:59.133749 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:37:59.134269 17936 external_mini_cluster.cc:1428] Setting key 5e317f45e75f020a449c130895881356
Aug 11 01:37:59 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412279, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:59.153332 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.133177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:56931 (local address 127.17.132.62:35039)
0811 01:37:59.133745 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.133752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.134859 (+ 1107us) server_negotiation.cc:407] Connection header received
0811 01:37:59.136869 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.136877 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.136959 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.137099 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:59.138750 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.139945 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.141569 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.142412 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.142564 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.146666 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:59.146673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:59.146677 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:59.146714 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:59.149570 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.150563 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.150568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.150571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.150709 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.151228 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.151233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.151235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.151556 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:59.151737 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.152575 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.152839 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":266,"threads_started":1}
I20260811 01:37:59.154531 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.133772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35039 (local address 127.17.132.2:56931)
0811 01:37:59.134690 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:59.134736 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:59.136593 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:59.137317 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:59.137325 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:59.137957 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:59.138557 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.138575 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.140110 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.140114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.141398 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.141411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.142638 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.142643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.142850 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.143642 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:59.143682 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:59.146383 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:59.149777 (+ 3394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:59.149814 (+ 37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:59.149836 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:59.150389 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:59.150841 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:59.150848 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:59.150852 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:59.151078 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:59.151718 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:59.151727 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:59.152129 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 01:37:59.152438 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 01:37:59.153057 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":387,"threads_started":1}
I20260811 01:37:59.156337 22748 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35039
I20260811 01:37:59.156698 22748 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:59.157429 22748 heartbeater.cc:511] Master 127.17.132.62:35039 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:37:59.159261 22401 ts_manager.cc:194] Registered new tserver with Master: e1dee15f19ad4644b9d3dcac49ca5610 (127.17.132.2:34483)
I20260811 01:37:59.160111 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:56931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:37:59.193328 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:59.554535 22754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:59.554860 22754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:59.555058 22754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:59.563196 22754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:59.563333 22754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:59.563555 22754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:37:59.574906 22754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:59.576534 22754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:59.578200 22754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:59.593083 22759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:59.593032 22762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:59.593016 22760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:59.594229 22754 server_base.cc:1034] running on GCE node
I20260811 01:37:59.594904 22754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:59.595949 22754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:59.597190 22754 hybrid_clock.cc:648] HybridClock initialized: now 1786412279597144 us; error 31 us; skew 500 ppm
I20260811 01:37:59.597509 22754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:59 dist-test-slave-0kls krb5kdc[22353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412279, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:59.601173 22754 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:37:59.602736 22754 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:59.602849 22754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:59.603211 22754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:59.606748 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "951f78f8eaa34b22b8b63a430108a1f9"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "40cc30928b8728083de812674a322c66"
server_key_iv: "a024c4f59236c97316414633138e93d3"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.607798 22754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "951f78f8eaa34b22b8b63a430108a1f9"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "40cc30928b8728083de812674a322c66"
server_key_iv: "a024c4f59236c97316414633138e93d3"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.608038 22603 heartbeater.cc:503] Master 127.17.132.62:35039 was elected leader, sending a full tablet report...
I20260811 01:37:59.614387 22754 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:37:59.618635 22769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.620333 22754 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:37:59.620565 22754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "951f78f8eaa34b22b8b63a430108a1f9"
format_stamp: "Formatted at 2026-08-11 01:37:59 on dist-test-slave-0kls"
server_key: "40cc30928b8728083de812674a322c66"
server_key_iv: "a024c4f59236c97316414633138e93d3"
server_key_version: "encryptionkey@0"
I20260811 01:37:59.620828 22754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:59.638996 22754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:59.643960 22754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:59.644241 22754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:59.645248 22754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:37:59.646875 22754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:37:59.646968 22754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.647051 22754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:37:59.647120 22754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:59.684515 22754 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:44137
I20260811 01:37:59.684588 22890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:44137 every 8 connection(s)
I20260811 01:37:59.685482 22754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:37:59.690353 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22754
I20260811 01:37:59.690565 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:37:59.691009 17936 external_mini_cluster.cc:1428] Setting key 6ae61ab8a1ad022217c2384d6018064c
Aug 11 01:37:59 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412279, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:37:59.709564 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.688161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:37147 (local address 127.17.132.62:35039)
0811 01:37:59.688690 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.688695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.689885 (+ 1190us) server_negotiation.cc:407] Connection header received
0811 01:37:59.692102 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.692109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.692262 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.692388 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:59.694494 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.695289 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.697002 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.697504 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.697629 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.701877 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:59.701884 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:59.701888 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:59.701930 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:59.705100 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.706665 (+ 1565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.706671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.706674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.706839 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.707474 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.707479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.707482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.707891 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:59.708071 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.708891 (+ 820us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.709166 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":281,"threads_started":1}
I20260811 01:37:59.710656 22894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.688678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35039 (local address 127.17.132.3:37147)
0811 01:37:59.689579 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:59.689619 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:59.691687 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:59.692682 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:59.692692 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:59.693434 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:59.694279 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.694310 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.695446 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.695451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.696811 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.696826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.697747 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.697753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.698051 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.698793 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:59.698818 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:59.701455 (+ 2637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:59.705322 (+ 3867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:59.705331 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:59.705350 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:59.706262 (+ 912us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:59.706977 (+ 715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:59.706983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:59.706987 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:59.707333 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:59.708041 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:59.708050 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:59.708468 (+ 418us) client_negotiation.cc:769] Sending connection context
0811 01:37:59.708759 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 01:37:59.709401 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":453,"threads_started":1}
I20260811 01:37:59.712417 22891 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35039
I20260811 01:37:59.712862 22891 heartbeater.cc:464] Registering TS with master...
I20260811 01:37:59.713657 22891 heartbeater.cc:511] Master 127.17.132.62:35039 requested a full tablet report, sending...
I20260811 01:37:59.715432 22401 ts_manager.cc:194] Registered new tserver with Master: 951f78f8eaa34b22b8b63a430108a1f9 (127.17.132.3:44137)
I20260811 01:37:59.716377 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:37147
I20260811 01:37:59.720638 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:37:59.740628 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.725728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57250 (local address 127.17.132.62:35039)
0811 01:37:59.725946 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.725973 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.726551 (+ 578us) server_negotiation.cc:407] Connection header received
0811 01:37:59.726774 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.726784 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.726868 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.726994 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:59.728835 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.729625 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.731053 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.731505 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.731676 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.734661 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:59.734666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:59.734670 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:59.734712 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:59.737463 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.738360 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.738366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.738369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.738508 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:59.738960 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:59.738964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:59.738967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:59.739334 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:59.739614 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.740028 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.740299 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 01:37:59.745069 22401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:37:59.752364 22401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:37:59.790829 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.766017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39440 (local address 127.17.132.2:34483)
0811 01:37:59.781403 (+ 15386us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.781413 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.781449 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:37:59.781558 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.781566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.781861 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.782090 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:59.783573 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.785059 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.788615 (+ 3556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.789581 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.789755 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.790010 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.790338 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.790517 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15172,"thread_start_us":15816,"threads_started":1}
I20260811 01:37:59.791199 22907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.766487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51074 (local address 127.17.132.1:44567)
0811 01:37:59.781668 (+ 15181us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.781679 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.781708 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:37:59.781886 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.781894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.782175 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.782428 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:59.783395 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.785096 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.788087 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.789629 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.789765 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.790058 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.790684 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.790875 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14967,"thread_start_us":14782,"threads_started":1}
I20260811 01:37:59.792145 22906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.765770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:34483 (local address 127.0.0.1:39440)
0811 01:37:59.779616 (+ 13846us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:59.779707 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:59.780032 (+ 325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:59.782417 (+ 2385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:59.782425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:59.782483 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:59.783389 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.783403 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.785219 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.785225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.788447 (+ 3222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.788459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.789857 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.789865 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.790069 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.790131 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 01:37:59.790294 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 01:37:59.790503 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13382,"mutex_wait_us":470,"spinlock_wait_cycles":3840,"thread_start_us":15034,"threads_started":1}
I20260811 01:37:59.792884 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.782687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:44137 (local address 127.0.0.1:42628)
0811 01:37:59.783644 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:59.783665 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:59.783791 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:59.784649 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:59.784654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:59.784680 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:59.785099 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.785111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.787479 (+ 2368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.787485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.789733 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.789748 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.791953 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.791959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.792158 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.792196 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:37:59.792318 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:37:59.792457 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":1,"thread_start_us":855,"threads_started":1}
I20260811 01:37:59.793030 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.781839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.17.132.3:44137)
0811 01:37:59.783192 (+ 1353us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:59.783202 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:59.783920 (+ 718us) server_negotiation.cc:407] Connection header received
0811 01:37:59.784106 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:59.784113 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:59.784338 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:59.784529 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:37:59.785570 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.787294 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.789966 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.791728 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.791860 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.792107 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:59.792470 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 01:37:59.792657 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1171,"thread_start_us":1019,"threads_started":1}
I20260811 01:37:59.793390 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:59.766050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:44567 (local address 127.0.0.1:51074)
0811 01:37:59.780622 (+ 14572us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:59.780642 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:59.780760 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:59.782416 (+ 1656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:59.782425 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:59.782485 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:37:59.782989 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.783012 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.785315 (+ 2303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.785324 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.787882 (+ 2558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:59.787900 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:59.790273 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:59.790281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:59.790473 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:59.790512 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:37:59.791517 (+ 1005us) client_negotiation.cc:240] Negotiation successful
0811 01:37:59.791672 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14449,"mutex_wait_us":4,"spinlock_wait_cycles":11776,"thread_start_us":14277,"threads_started":1}
I20260811 01:37:59.796702 22533 tablet_service.cc:1467] Processing CreateTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 (DEFAULT_TABLE table=test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:59.796715 22676 tablet_service.cc:1467] Processing CreateTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 (DEFAULT_TABLE table=test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:59.797075 22823 tablet_service.cc:1467] Processing CreateTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 (DEFAULT_TABLE table=test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:37:59.798316 22533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f79c3368de41b2b9ff68e64f2eb506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:59.798318 22676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f79c3368de41b2b9ff68e64f2eb506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:59.798415 22823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f79c3368de41b2b9ff68e64f2eb506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:59.811626 22910 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Bootstrap starting.
I20260811 01:37:59.815054 22910 tablet_bootstrap.cc:654] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:59.816450 22910 log.cc:824] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:59.817512 22911 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Bootstrap starting.
I20260811 01:37:59.818442 22912 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Bootstrap starting.
I20260811 01:37:59.821909 22911 tablet_bootstrap.cc:654] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:59.822080 22912 tablet_bootstrap.cc:654] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:59.822423 22910 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: No bootstrap required, opened a new log
I20260811 01:37:59.822774 22910 ts_tablet_manager.cc:1397] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:37:59.823277 22911 log.cc:824] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:59.823427 22912 log.cc:824] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:59.826638 22911 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: No bootstrap required, opened a new log
I20260811 01:37:59.826933 22911 ts_tablet_manager.cc:1397] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260811 01:37:59.828447 22912 tablet_bootstrap.cc:492] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: No bootstrap required, opened a new log
I20260811 01:37:59.828744 22912 ts_tablet_manager.cc:1397] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:37:59.834128 22910 raft_consensus.cc:348] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.834676 22910 raft_consensus.cc:374] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:59.834776 22910 raft_consensus.cc:729] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db7f315c36234c1e953db291ec83101f, State: Initialized, Role: FOLLOWER
I20260811 01:37:59.835229 22911 raft_consensus.cc:348] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.835642 22911 raft_consensus.cc:374] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:59.835719 22911 raft_consensus.cc:729] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1dee15f19ad4644b9d3dcac49ca5610, State: Initialized, Role: FOLLOWER
I20260811 01:37:59.835656 22910 consensus_queue.cc:260] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.836392 22911 consensus_queue.cc:260] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.842141 22912 raft_consensus.cc:348] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.842849 22912 raft_consensus.cc:374] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:37:59.842988 22912 raft_consensus.cc:729] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951f78f8eaa34b22b8b63a430108a1f9, State: Initialized, Role: FOLLOWER
I20260811 01:37:59.843878 22912 consensus_queue.cc:260] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:37:59.845438 22910 ts_tablet_manager.cc:1428] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Time spent starting tablet: real 0.023s user 0.009s sys 0.011s
I20260811 01:37:59.846829 22748 heartbeater.cc:503] Master 127.17.132.62:35039 was elected leader, sending a full tablet report...
I20260811 01:37:59.847915 22911 ts_tablet_manager.cc:1428] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Time spent starting tablet: real 0.021s user 0.002s sys 0.016s
I20260811 01:37:59.849025 22891 heartbeater.cc:503] Master 127.17.132.62:35039 was elected leader, sending a full tablet report...
I20260811 01:37:59.849625 22912 ts_tablet_manager.cc:1428] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Time spent starting tablet: real 0.021s user 0.014s sys 0.003s
W20260811 01:37:59.882679 22749 tablet.cc:2369] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:37:59.937227 22892 tablet.cc:2369] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:00.043551 22917 raft_consensus.cc:482] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:00.043855 22917 raft_consensus.cc:504] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:38:00.045545 22917 leader_election.cc:288] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1dee15f19ad4644b9d3dcac49ca5610 (127.17.132.2:34483), 951f78f8eaa34b22b8b63a430108a1f9 (127.17.132.3:44137)
I20260811 01:38:00.053864 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.046174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:36333 (local address 127.17.132.2:34483)
0811 01:38:00.046407 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.046414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.046702 (+ 288us) server_negotiation.cc:407] Connection header received
0811 01:38:00.046962 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.046970 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.047079 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.047187 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:00.047898 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.048921 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.051505 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.052787 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.052963 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.053055 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.053404 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.053556 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:38:00.053870 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.046852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:59271 (local address 127.17.132.3:44137)
0811 01:38:00.047062 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.047070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.047548 (+ 478us) server_negotiation.cc:407] Connection header received
0811 01:38:00.047714 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.047718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.047777 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.047893 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:00.048355 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.049287 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.051701 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.052964 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.053140 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.053191 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.053497 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.053616 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:38:00.053946 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.045906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:34483 (local address 127.17.132.1:36333)
0811 01:38:00.046538 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:00.046581 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:00.046762 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:00.047248 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:00.047253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:00.047281 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:00.047757 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:00.047767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.049046 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.049049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:00.051325 (+ 2276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:00.051342 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.052991 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.052995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:00.053220 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.053259 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:38:00.053361 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 01:38:00.053506 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":327,"threads_started":1}
I20260811 01:38:00.054000 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.046629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:44137 (local address 127.17.132.1:59271)
0811 01:38:00.047420 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:00.047443 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:00.047574 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:00.047927 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:00.047930 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:00.047950 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:00.048199 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:00.048205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.049421 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.049426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:00.051542 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:00.051552 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.053166 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.053173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:00.053343 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.053375 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 01:38:00.053448 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 01:38:00.053543 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":422,"threads_started":1}
I20260811 01:38:00.054952 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f79c3368de41b2b9ff68e64f2eb506" candidate_uuid: "db7f315c36234c1e953db291ec83101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951f78f8eaa34b22b8b63a430108a1f9" is_pre_election: true
I20260811 01:38:00.055253 22700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f79c3368de41b2b9ff68e64f2eb506" candidate_uuid: "db7f315c36234c1e953db291ec83101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" is_pre_election: true
I20260811 01:38:00.055471 22843 raft_consensus.cc:2454] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db7f315c36234c1e953db291ec83101f in term 0.
I20260811 01:38:00.055766 22700 raft_consensus.cc:2454] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db7f315c36234c1e953db291ec83101f in term 0.
I20260811 01:38:00.056216 22484 leader_election.cc:302] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951f78f8eaa34b22b8b63a430108a1f9, db7f315c36234c1e953db291ec83101f; no voters:
I20260811 01:38:00.056602 22917 raft_consensus.cc:2781] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:00.056763 22917 raft_consensus.cc:482] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:00.056881 22917 raft_consensus.cc:3037] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:00.059158 22917 raft_consensus.cc:504] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:38:00.059808 22917 leader_election.cc:288] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [CANDIDATE]: Term 1 election: Requested vote from peers e1dee15f19ad4644b9d3dcac49ca5610 (127.17.132.2:34483), 951f78f8eaa34b22b8b63a430108a1f9 (127.17.132.3:44137)
I20260811 01:38:00.060186 22700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f79c3368de41b2b9ff68e64f2eb506" candidate_uuid: "db7f315c36234c1e953db291ec83101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1dee15f19ad4644b9d3dcac49ca5610"
I20260811 01:38:00.060339 22843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f79c3368de41b2b9ff68e64f2eb506" candidate_uuid: "db7f315c36234c1e953db291ec83101f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951f78f8eaa34b22b8b63a430108a1f9"
I20260811 01:38:00.060386 22700 raft_consensus.cc:3037] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:00.060549 22843 raft_consensus.cc:3037] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:00.062835 22700 raft_consensus.cc:2454] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db7f315c36234c1e953db291ec83101f in term 1.
I20260811 01:38:00.062983 22843 raft_consensus.cc:2454] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db7f315c36234c1e953db291ec83101f in term 1.
I20260811 01:38:00.063261 22484 leader_election.cc:302] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db7f315c36234c1e953db291ec83101f, e1dee15f19ad4644b9d3dcac49ca5610; no voters:
I20260811 01:38:00.063566 22917 raft_consensus.cc:2781] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:00.064014 22917 raft_consensus.cc:686] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 1 LEADER]: Becoming Leader. State: Replica: db7f315c36234c1e953db291ec83101f, State: Running, Role: LEADER
I20260811 01:38:00.064527 22917 consensus_queue.cc:237] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } }
I20260811 01:38:00.069866 22401 catalog_manager.cc:5495] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f reported cstate change: term changed from 0 to 1, leader changed from <none> to db7f315c36234c1e953db291ec83101f (127.17.132.1). New cstate: current_term: 1 leader_uuid: "db7f315c36234c1e953db291ec83101f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db7f315c36234c1e953db291ec83101f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 44567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 } health_report { overall_health: UNKNOWN } } }
W20260811 01:38:00.074857 22604 tablet.cc:2369] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:00.097321 22907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.091881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.17.132.1:44567)
0811 01:38:00.092088 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.092093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.092111 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:38:00.092213 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.092217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.092305 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.092430 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:00.092860 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.093606 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.095081 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.095488 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.095582 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.096069 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:00.096617 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:00.096734 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.096872 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.096943 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:38:00.106245 22843 raft_consensus.cc:1261] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 1 FOLLOWER]: Refusing update from remote peer db7f315c36234c1e953db291ec83101f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:00.106297 22700 raft_consensus.cc:1261] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 1 FOLLOWER]: Refusing update from remote peer db7f315c36234c1e953db291ec83101f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:00.107322 22923 consensus_queue.cc:1035] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [LEADER]: Connected to new peer: Peer: permanent_uuid: "951f78f8eaa34b22b8b63a430108a1f9" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:00.107812 22917 consensus_queue.cc:1035] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1dee15f19ad4644b9d3dcac49ca5610" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:00.120940 22926 mvcc.cc:205] Tried to move back new op lower bound from 7317144699303841792 to 7317144699148042240. Current Snapshot: MvccSnapshot[applied={T|T < 7317144699303841792}]
I20260811 01:38:00.138360 22401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:00.138675 22401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:00.143705 22401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9b5097b5d0d43e2aac13d389aa40b58: Sending DeleteTablet for 3 replicas of tablet 56f79c3368de41b2b9ff68e64f2eb506
I20260811 01:38:00.145020 22676 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:00 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:39440
I20260811 01:38:00.145042 22533 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:00 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51074
I20260811 01:38:00.147392 22823 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f79c3368de41b2b9ff68e64f2eb506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:00 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:42628
I20260811 01:38:00.158880 22939 tablet_replica.cc:330] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: stopping tablet replica
I20260811 01:38:00.159161 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22466
I20260811 01:38:00.159436 22939 raft_consensus.cc:2229] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:00.160068 22939 raft_consensus.cc:2258] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:00.160928 22938 tablet_replica.cc:330] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: stopping tablet replica
I20260811 01:38:00.161374 22938 raft_consensus.cc:2229] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:00.161934 22938 raft_consensus.cc:2258] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:00.162756 22937 tablet_replica.cc:330] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: stopping tablet replica
I20260811 01:38:00.163122 22939 ts_tablet_manager.cc:1905] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:00.163285 22937 raft_consensus.cc:2229] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:00.164119 22937 raft_consensus.cc:2258] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:00.166929 22938 ts_tablet_manager.cc:1905] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:00.166919 22937 ts_tablet_manager.cc:1905] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:00.175092 22938 ts_tablet_manager.cc:1918] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:00.175380 22938 log.cc:1196] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/56f79c3368de41b2b9ff68e64f2eb506
I20260811 01:38:00.176047 22938 ts_tablet_manager.cc:1939] T 56f79c3368de41b2b9ff68e64f2eb506 P e1dee15f19ad4644b9d3dcac49ca5610: Deleting consensus metadata
Aug 11 01:38:00 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:38:00.178838 22385 catalog_manager.cc:4841] TS e1dee15f19ad4644b9d3dcac49ca5610 (127.17.132.2:34483): tablet 56f79c3368de41b2b9ff68e64f2eb506 (table test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]) successfully deleted
I20260811 01:38:00.180704 22939 ts_tablet_manager.cc:1918] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:00.180912 22939 log.cc:1196] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/56f79c3368de41b2b9ff68e64f2eb506
I20260811 01:38:00.181535 22939 ts_tablet_manager.cc:1939] T 56f79c3368de41b2b9ff68e64f2eb506 P 951f78f8eaa34b22b8b63a430108a1f9: Deleting consensus metadata
I20260811 01:38:00.183288 22937 ts_tablet_manager.cc:1918] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:00.183588 22937 log.cc:1196] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/56f79c3368de41b2b9ff68e64f2eb506
I20260811 01:38:00.183702 22385 catalog_manager.cc:4841] TS 951f78f8eaa34b22b8b63a430108a1f9 (127.17.132.3:44137): tablet 56f79c3368de41b2b9ff68e64f2eb506 (table test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]) successfully deleted
I20260811 01:38:00.184319 22937 ts_tablet_manager.cc:1939] T 56f79c3368de41b2b9ff68e64f2eb506 P db7f315c36234c1e953db291ec83101f: Deleting consensus metadata
I20260811 01:38:00.186280 22384 catalog_manager.cc:4841] TS db7f315c36234c1e953db291ec83101f (127.17.132.1:44567): tablet 56f79c3368de41b2b9ff68e64f2eb506 (table test-table [id=bde78a8417a34dbe9c9ee29fae42cbed]) successfully deleted
I20260811 01:38:00.186571 22907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.160789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51092 (local address 127.17.132.1:44567)
0811 01:38:00.161000 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.161006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.165219 (+ 4213us) server_negotiation.cc:407] Connection header received
0811 01:38:00.165452 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.165457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.165545 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.165663 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:00.167800 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.169073 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.171047 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.171726 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.171827 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.177636 (+ 5809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:00.177661 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:00.177690 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:00.177756 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:00.182576 (+ 4820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.183861 (+ 1285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.183872 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.183875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.184088 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.184567 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.184570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.184573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.185074 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:00.185302 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.185862 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.186125 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:38:00.187642 22597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:00.290114 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22466
I20260811 01:38:00.315079 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22609
Aug 11 01:38:00 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:38:00.337440 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.315897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39456 (local address 127.17.132.2:34483)
0811 01:38:00.316084 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.316090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.316122 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:00.316292 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.316296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.316370 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.316460 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:00.317962 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.318905 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.320269 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.320703 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.320818 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.330826 (+ 10008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:00.330846 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:00.330863 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:00.330907 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:00.334035 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.334833 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.334841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.334844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.334979 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.335475 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.335479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.335482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.335918 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:00.336178 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.336595 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.336794 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:38:00.338187 22743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:00.430732 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22609
I20260811 01:38:00.452296 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22754
Aug 11 01:38:00 dist-test-slave-0kls krb5kdc[22353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:38:00.468068 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:00.453201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.17.132.3:44137)
0811 01:38:00.453384 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:00.453389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:00.453407 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:38:00.453466 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:00.453470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:00.453535 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:00.453651 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:00.454964 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.455689 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.456902 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:00.457334 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:00.457440 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:00.462078 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:00.462097 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:00.462116 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:00.462158 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:00.465107 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.465938 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.465946 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.465949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.466119 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:00.466511 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:00.466515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:00.466517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:00.466900 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:00.467153 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:00.467538 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 01:38:00.467759 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:38:00.468904 22886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:00.563170 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22754
I20260811 01:38:00.586028 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22366
I20260811 01:38:00.587347 22432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:00.701164 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22366
2026-08-11T01:38:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4779 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T01:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:00Z Disabled control of system clock
I20260811 01:38:00.782835 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36233
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:38:01.141127 22949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:01.141507 22949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:01.141673 22949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:01.149401 22949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:01.149549 22949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:01.149590 22949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:01.149722 22949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:01.149848 22949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:01.160166 22949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36233
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:01.161624 22949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:01.163695 22949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:01.177379 22955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:01.177470 22958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:01.177352 22956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:01.178216 22949 server_base.cc:1034] running on GCE node
I20260811 01:38:01.179086 22949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:01.180719 22949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:01.181996 22949 hybrid_clock.cc:648] HybridClock initialized: now 1786412281181956 us; error 68 us; skew 500 ppm
I20260811 01:38:01.182430 22949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:01.185030 22949 webserver.cc:460] Webserver started at http://127.17.132.62:32813/ using document root <none> and password file <none>
I20260811 01:38:01.185930 22949 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:01.186077 22949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:01.186453 22949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:01.189720 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "1862b9f766084af39d4a8a5880e7eccc"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "6b603831829e3fa1a65f53ce774f8886"
server_key_iv: "a0592753c4b4df368ab48d939bdc67a5"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.190714 22949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "1862b9f766084af39d4a8a5880e7eccc"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "6b603831829e3fa1a65f53ce774f8886"
server_key_iv: "a0592753c4b4df368ab48d939bdc67a5"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.196666 22949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:01.200723 22965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:01.202487 22949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:01.202732 22949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "1862b9f766084af39d4a8a5880e7eccc"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "6b603831829e3fa1a65f53ce774f8886"
server_key_iv: "a0592753c4b4df368ab48d939bdc67a5"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.203011 22949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:01.209560 22949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:01.210554 22949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:01.210901 22949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:01.230930 22949 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:36233
I20260811 01:38:01.230953 23020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:36233 every 8 connection(s)
I20260811 01:38:01.232457 22949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:01.236461 23022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:01.239117 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 22949
I20260811 01:38:01.239375 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:01.240123 17936 external_mini_cluster.cc:1428] Setting key 414a121ba8b4158b8c7579e45d65a2ac
I20260811 01:38:01.250813 23025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:01.242568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47478 (local address 127.17.132.62:36233)
0811 01:38:01.243711 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:01.243727 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:01.243786 (+ 59us) server_negotiation.cc:407] Connection header received
0811 01:38:01.246201 (+ 2415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:01.246239 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:01.246885 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:01.247430 (+ 545us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:01.248652 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:01.248660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:01.248678 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:01.248699 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:01.248784 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:01.248812 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:01.249044 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:01.249180 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 01:38:01.249458 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":362,"threads_started":1}
I20260811 01:38:01.251302 23022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: Bootstrap starting.
I20260811 01:38:01.255267 23022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:01.256354 23022 log.cc:824] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:01.259716 23022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: No bootstrap required, opened a new log
I20260811 01:38:01.267568 23022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } }
I20260811 01:38:01.268042 23022 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:01.268160 23022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1862b9f766084af39d4a8a5880e7eccc, State: Initialized, Role: FOLLOWER
I20260811 01:38:01.268841 23022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } }
I20260811 01:38:01.269100 23022 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:01.269261 23022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:01.269449 23022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:01.271894 23022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } }
I20260811 01:38:01.272433 23022 leader_election.cc:302] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1862b9f766084af39d4a8a5880e7eccc; no voters:
I20260811 01:38:01.273094 23022 leader_election.cc:288] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:01.273274 23027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:01.274066 23027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [term 1 LEADER]: Becoming Leader. State: Replica: 1862b9f766084af39d4a8a5880e7eccc, State: Running, Role: LEADER
I20260811 01:38:01.274740 23027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } }
I20260811 01:38:01.275471 23022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:01.278008 23028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1862b9f766084af39d4a8a5880e7eccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } } }
I20260811 01:38:01.278517 23028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:01.282780 23029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1862b9f766084af39d4a8a5880e7eccc. Latest consensus state: current_term: 1 leader_uuid: "1862b9f766084af39d4a8a5880e7eccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1862b9f766084af39d4a8a5880e7eccc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36233 } } }
I20260811 01:38:01.283358 23029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:01.287006 23035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:01.291972 23035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:01.300822 23035 catalog_manager.cc:1347] Generated new cluster ID: 9663aaffed654bf0b5a497604c75f4ba
I20260811 01:38:01.300961 23035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:01.309918 23035 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:01.310482 23035 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:01.327425 23035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: Generated new TSK 0
I20260811 01:38:01.328648 23035 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:01.345160 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--builtin_ntp_servers=127.17.132.20:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:38:01.706801 23046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:01.707237 23046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:01.707414 23046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:01.715543 23046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:01.715720 23046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:01.715901 23046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:01.725417 23046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:01.726855 23046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:01.728806 23046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:01.743432 23055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:01.743557 23053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:01.743582 23052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:01.744282 23046 server_base.cc:1034] running on GCE node
I20260811 01:38:01.745011 23046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:01.746157 23046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:01.747413 23046 hybrid_clock.cc:648] HybridClock initialized: now 1786412281747345 us; error 61 us; skew 500 ppm
I20260811 01:38:01.747810 23046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:01.750499 23046 webserver.cc:460] Webserver started at http://127.17.132.1:42687/ using document root <none> and password file <none>
I20260811 01:38:01.751266 23046 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:01.751408 23046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:01.751777 23046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:01.754870 23046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "e6896a6399eb49c994743fdfe7140114"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "edea88e30ba1ab5d0c3c5c47704d4709"
server_key_iv: "3bda8dcb674d8c52003a53ff6addcd2b"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.755724 23046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "e6896a6399eb49c994743fdfe7140114"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "edea88e30ba1ab5d0c3c5c47704d4709"
server_key_iv: "3bda8dcb674d8c52003a53ff6addcd2b"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.761899 23046 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:38:01.765741 23061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:01.767406 23046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:01.767659 23046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e6896a6399eb49c994743fdfe7140114"
format_stamp: "Formatted at 2026-08-11 01:38:01 on dist-test-slave-0kls"
server_key: "edea88e30ba1ab5d0c3c5c47704d4709"
server_key_iv: "3bda8dcb674d8c52003a53ff6addcd2b"
server_key_version: "encryptionkey@0"
I20260811 01:38:01.767970 23046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:01.774447 23046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:01.775393 23046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:01.775717 23046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:01.776762 23046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:01.778493 23046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:01.778628 23046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:01.778760 23046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:01.778853 23046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:01.816907 23046 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:35663
I20260811 01:38:01.817013 23181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:35663 every 8 connection(s)
I20260811 01:38:01.818392 23046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:01.822947 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23046
I20260811 01:38:01.823175 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:01.823819 17936 external_mini_cluster.cc:1428] Setting key c7c0a2c9218b81772616766d5a676d23
I20260811 01:38:01.827044 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--builtin_ntp_servers=127.17.132.20:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:38:01.827703 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:01.821107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:49737 (local address 127.17.132.62:36233)
0811 01:38:01.821633 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:01.821639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:01.822862 (+ 1223us) server_negotiation.cc:407] Connection header received
0811 01:38:01.824883 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:01.824889 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:01.824974 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:01.825107 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:01.826724 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:01.826730 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:01.826734 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:01.826760 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:01.826834 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:01.826852 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:01.827012 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:01.827276 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 01:38:01.827344 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":239,"threads_started":1}
I20260811 01:38:01.829150 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:01.821705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36233 (local address 127.17.132.1:49737)
0811 01:38:01.822696 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:01.822739 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:01.824573 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:01.825375 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:01.825383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:01.825481 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:01.826362 (+ 881us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:01.826368 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:01.826428 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:01.826526 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:01.826990 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:01.827005 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:01.827017 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:38:01.827341 (+ 324us) client_negotiation.cc:240] Negotiation successful
0811 01:38:01.827743 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":287,"threads_started":1}
I20260811 01:38:01.830982 23182 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36233
I20260811 01:38:01.831336 23182 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:01.832120 23182 heartbeater.cc:511] Master 127.17.132.62:36233 requested a full tablet report, sending...
I20260811 01:38:01.834708 22984 ts_manager.cc:194] Registered new tserver with Master: e6896a6399eb49c994743fdfe7140114 (127.17.132.1:35663)
W20260811 01:38:02.198338 23186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:02.198896 23186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:02.199100 23186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:02.209931 23186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:02.210168 23186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:02.210376 23186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:02.220348 23186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:02.221771 23186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:02.223840 23186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:02.239662 23192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:02.239653 23196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:02.239960 23193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:02.240818 23186 server_base.cc:1034] running on GCE node
I20260811 01:38:02.241619 23186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:02.242754 23186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:02.244024 23186 hybrid_clock.cc:648] HybridClock initialized: now 1786412282243942 us; error 64 us; skew 500 ppm
I20260811 01:38:02.244418 23186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:02.247171 23186 webserver.cc:460] Webserver started at http://127.17.132.2:46181/ using document root <none> and password file <none>
I20260811 01:38:02.247951 23186 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:02.248101 23186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:02.248467 23186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:02.251586 23186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "7cbfdeca5d624a3fa5930749d77cfd9c"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "25f45ab49f6a6faf5ee4e3462cadd5ee"
server_key_iv: "3842d8e985da4a2dcbaa073db928c839"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.252472 23186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "7cbfdeca5d624a3fa5930749d77cfd9c"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "25f45ab49f6a6faf5ee4e3462cadd5ee"
server_key_iv: "3842d8e985da4a2dcbaa073db928c839"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.258399 23186 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:38:02.262490 23202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.264410 23186 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:38:02.264647 23186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "7cbfdeca5d624a3fa5930749d77cfd9c"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "25f45ab49f6a6faf5ee4e3462cadd5ee"
server_key_iv: "3842d8e985da4a2dcbaa073db928c839"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.264969 23186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:02.271571 23186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:02.272600 23186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:02.272863 23186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:02.274061 23186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:02.275771 23186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:02.275892 23186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.276005 23186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:02.276067 23186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.315168 23186 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:45987
I20260811 01:38:02.315232 23325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:45987 every 8 connection(s)
I20260811 01:38:02.316651 23186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:02.325377 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23186
I20260811 01:38:02.325639 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:02.326244 17936 external_mini_cluster.cc:1428] Setting key 0fde709eb540458574cec96c0687ffc4
I20260811 01:38:02.326253 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.319816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:47775 (local address 127.17.132.62:36233)
0811 01:38:02.320104 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.320110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.321621 (+ 1511us) server_negotiation.cc:407] Connection header received
0811 01:38:02.323497 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.323502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.323578 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.323683 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.325392 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.325397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.325404 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.325426 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.325468 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.325483 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.325678 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.325944 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.326015 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 01:38:02.327575 23328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.320444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36233 (local address 127.17.132.2:47775)
0811 01:38:02.321455 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:02.321492 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:02.323201 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:02.323963 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:02.323972 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:02.324109 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:02.324887 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:02.324893 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:02.324955 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:02.325132 (+ 177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:02.325655 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:02.325668 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:02.325678 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:38:02.326020 (+ 342us) client_negotiation.cc:240] Negotiation successful
0811 01:38:02.326353 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":319,"threads_started":1}
I20260811 01:38:02.329172 23326 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36233
I20260811 01:38:02.329515 23326 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:02.329689 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--builtin_ntp_servers=127.17.132.20:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:38:02.330295 23326 heartbeater.cc:511] Master 127.17.132.62:36233 requested a full tablet report, sending...
I20260811 01:38:02.331811 22984 ts_manager.cc:194] Registered new tserver with Master: 7cbfdeca5d624a3fa5930749d77cfd9c (127.17.132.2:45987)
W20260811 01:38:02.697300 23329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:02.697629 23329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:02.697791 23329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:02.705655 23329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:02.705775 23329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:02.706059 23329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:02.716120 23329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:02.717552 23329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:02.719470 23329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:02.733363 23335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:02.733294 23338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:02.733618 23334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:02.735206 23329 server_base.cc:1034] running on GCE node
I20260811 01:38:02.735977 23329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:02.737097 23329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:02.738346 23329 hybrid_clock.cc:648] HybridClock initialized: now 1786412282738287 us; error 53 us; skew 500 ppm
I20260811 01:38:02.738713 23329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:02.741243 23329 webserver.cc:460] Webserver started at http://127.17.132.3:33207/ using document root <none> and password file <none>
I20260811 01:38:02.742123 23329 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:02.742273 23329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:02.742645 23329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:02.745958 23329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "073de7658f754742ade81d419ca47082"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "c4d58a7e69e29a30a2041ee818ce21e8"
server_key_iv: "7cb4c9cea3b308b1b672782322892b2f"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.746829 23329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "073de7658f754742ade81d419ca47082"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "c4d58a7e69e29a30a2041ee818ce21e8"
server_key_iv: "7cb4c9cea3b308b1b672782322892b2f"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.752731 23329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:02.756652 23345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.758153 23329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:38:02.758358 23329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "073de7658f754742ade81d419ca47082"
format_stamp: "Formatted at 2026-08-11 01:38:02 on dist-test-slave-0kls"
server_key: "c4d58a7e69e29a30a2041ee818ce21e8"
server_key_iv: "7cb4c9cea3b308b1b672782322892b2f"
server_key_version: "encryptionkey@0"
I20260811 01:38:02.758626 23329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:02.764748 23329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:02.765609 23329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:02.765996 23329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:02.766957 23329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:02.768532 23329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:02.768632 23329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.768721 23329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:02.768778 23329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:02.805042 23329 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:43115
I20260811 01:38:02.805153 23467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:43115 every 8 connection(s)
I20260811 01:38:02.806454 23329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:02.806910 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23329
I20260811 01:38:02.807173 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:02.807865 17936 external_mini_cluster.cc:1428] Setting key eeffa05443c8b01a882e34c232e40bc2
I20260811 01:38:02.816640 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.809979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:55461 (local address 127.17.132.62:36233)
0811 01:38:02.810259 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.810267 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.812128 (+ 1861us) server_negotiation.cc:407] Connection header received
0811 01:38:02.814037 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.814043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.814127 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.814254 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.815780 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.815787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.815792 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.815816 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.815859 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.815871 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.816009 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.816231 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.816307 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260811 01:38:02.817610 23470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.810731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36233 (local address 127.17.132.3:55461)
0811 01:38:02.811959 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:02.812004 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:02.813690 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:02.814496 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:02.814504 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:02.814615 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:02.815427 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:02.815429 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:02.815470 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:02.815572 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:02.815981 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:02.815993 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:02.816001 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:38:02.816322 (+ 321us) client_negotiation.cc:240] Negotiation successful
0811 01:38:02.816603 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":399,"threads_started":1}
I20260811 01:38:02.819231 23468 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36233
I20260811 01:38:02.819614 23468 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:02.820353 23468 heartbeater.cc:511] Master 127.17.132.62:36233 requested a full tablet report, sending...
I20260811 01:38:02.822098 22984 ts_manager.cc:194] Registered new tserver with Master: 073de7658f754742ade81d419ca47082 (127.17.132.3:43115)
I20260811 01:38:02.824460 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:38:02.831810 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.829016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47480 (local address 127.17.132.62:36233)
0811 01:38:02.829238 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.829246 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.829704 (+ 458us) server_negotiation.cc:407] Connection header received
0811 01:38:02.829967 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.829972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.830025 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.830133 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.831126 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.831131 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.831136 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.831156 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.831199 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.831211 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.831345 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.831460 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.831525 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:38:02.837880 23182 heartbeater.cc:503] Master 127.17.132.62:36233 was elected leader, sending a full tablet report...
I20260811 01:38:02.836439 22983 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:02.844398 22983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:02.879739 23483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.857566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.17.132.3:43115)
0811 01:38:02.871311 (+ 13745us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.871322 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.872370 (+ 1048us) server_negotiation.cc:407] Connection header received
0811 01:38:02.872863 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.872878 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.873205 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.873439 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.878606 (+ 5167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.878620 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.878641 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.878671 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.878781 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.878809 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.879033 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.879182 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.879311 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13525,"thread_start_us":13338,"threads_started":1}
I20260811 01:38:02.879818 23486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.857359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43115 (local address 127.0.0.1:43414)
0811 01:38:02.872179 (+ 14820us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:02.872241 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:02.872556 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:02.875248 (+ 2692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:02.875260 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:02.875408 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:02.877036 (+ 1628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:02.877038 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:02.877078 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:02.877169 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:02.878938 (+ 1769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:02.878953 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:02.878961 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:38:02.879187 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 01:38:02.879328 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14478,"thread_start_us":20497,"threads_started":1}
I20260811 01:38:02.880409 23485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.857856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48598 (local address 127.17.132.2:45987)
0811 01:38:02.870410 (+ 12554us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.870436 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.876674 (+ 6238us) server_negotiation.cc:407] Connection header received
0811 01:38:02.877399 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.877409 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.877679 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.877871 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.879339 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.879347 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.879361 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.879398 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.879459 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.879480 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.879606 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.879941 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.880066 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12284,"thread_start_us":12601,"threads_started":1}
I20260811 01:38:02.881465 23484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.857583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:45987 (local address 127.0.0.1:48598)
0811 01:38:02.876538 (+ 18955us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:02.876558 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:02.876772 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:02.878203 (+ 1431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:02.878210 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:02.878239 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:02.879073 (+ 834us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:02.879077 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:02.879095 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:02.879143 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:02.879722 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:02.879726 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:02.879730 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:38:02.880933 (+ 1203us) client_negotiation.cc:240] Negotiation successful
0811 01:38:02.880990 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18759,"spinlock_wait_cycles":14720,"thread_start_us":18748,"threads_started":1}
I20260811 01:38:02.882980 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.858737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36774)
0811 01:38:02.878162 (+ 19425us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:02.878181 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:02.878310 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:02.880150 (+ 1840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:02.880155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:02.880180 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:02.881841 (+ 1661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:02.881845 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:02.881862 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:02.881910 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:02.882378 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:02.882383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:02.882388 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:38:02.882531 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 01:38:02.882587 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19281,"thread_start_us":12816,"threads_started":1}
I20260811 01:38:02.883001 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:02.859165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36774 (local address 127.17.132.1:35663)
0811 01:38:02.877369 (+ 18204us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:02.877382 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:02.878337 (+ 955us) server_negotiation.cc:407] Connection header received
0811 01:38:02.878491 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:02.878499 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:02.879124 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:02.879294 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:02.882106 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:02.882116 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:02.882130 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:02.882153 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:02.882217 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:02.882239 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:02.882422 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:02.882503 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:38:02.882612 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17934,"thread_start_us":18206,"threads_started":1}
I20260811 01:38:02.884754 23397 tablet_service.cc:1467] Processing CreateTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef (DEFAULT_TABLE table=test-table [id=90bb5ce0f69f4fe88becbbb7d662c5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:02.885381 23254 tablet_service.cc:1467] Processing CreateTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef (DEFAULT_TABLE table=test-table [id=90bb5ce0f69f4fe88becbbb7d662c5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:02.886415 23397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c70714e0fda64a9f908a21b5b2c0c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:02.886713 23254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c70714e0fda64a9f908a21b5b2c0c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:02.888739 23113 tablet_service.cc:1467] Processing CreateTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef (DEFAULT_TABLE table=test-table [id=90bb5ce0f69f4fe88becbbb7d662c5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:02.890230 23113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c70714e0fda64a9f908a21b5b2c0c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:02.898650 23488 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Bootstrap starting.
I20260811 01:38:02.902199 23489 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Bootstrap starting.
I20260811 01:38:02.903672 23488 tablet_bootstrap.cc:654] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:02.905129 23488 log.cc:824] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:02.905335 23490 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Bootstrap starting.
I20260811 01:38:02.906497 23489 tablet_bootstrap.cc:654] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:02.907879 23489 log.cc:824] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:02.909484 23490 tablet_bootstrap.cc:654] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:02.910566 23488 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: No bootstrap required, opened a new log
I20260811 01:38:02.910887 23488 ts_tablet_manager.cc:1397] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260811 01:38:02.910921 23490 log.cc:824] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:02.911300 23489 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: No bootstrap required, opened a new log
I20260811 01:38:02.911638 23489 ts_tablet_manager.cc:1397] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 01:38:02.916921 23490 tablet_bootstrap.cc:492] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: No bootstrap required, opened a new log
I20260811 01:38:02.917259 23490 ts_tablet_manager.cc:1397] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 01:38:02.919862 23488 raft_consensus.cc:348] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.920308 23488 raft_consensus.cc:374] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:02.920442 23488 raft_consensus.cc:729] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cbfdeca5d624a3fa5930749d77cfd9c, State: Initialized, Role: FOLLOWER
I20260811 01:38:02.921129 23488 consensus_queue.cc:260] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.922344 23326 heartbeater.cc:503] Master 127.17.132.62:36233 was elected leader, sending a full tablet report...
I20260811 01:38:02.922655 23489 raft_consensus.cc:348] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.923133 23489 raft_consensus.cc:374] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:02.923236 23489 raft_consensus.cc:729] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073de7658f754742ade81d419ca47082, State: Initialized, Role: FOLLOWER
I20260811 01:38:02.923889 23489 consensus_queue.cc:260] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.924486 23488 ts_tablet_manager.cc:1428] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Time spent starting tablet: real 0.013s user 0.000s sys 0.012s
I20260811 01:38:02.925483 23468 heartbeater.cc:503] Master 127.17.132.62:36233 was elected leader, sending a full tablet report...
I20260811 01:38:02.926198 23489 ts_tablet_manager.cc:1428] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260811 01:38:02.928226 23490 raft_consensus.cc:348] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.928750 23490 raft_consensus.cc:374] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:02.928885 23490 raft_consensus.cc:729] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6896a6399eb49c994743fdfe7140114, State: Initialized, Role: FOLLOWER
I20260811 01:38:02.929625 23490 consensus_queue.cc:260] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:02.931421 23490 ts_tablet_manager.cc:1428] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260811 01:38:03.042589 23496 raft_consensus.cc:482] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:03.042927 23496 raft_consensus.cc:504] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:03.044710 23496 leader_election.cc:288] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cbfdeca5d624a3fa5930749d77cfd9c (127.17.132.2:45987), e6896a6399eb49c994743fdfe7140114 (127.17.132.1:35663)
I20260811 01:38:03.047987 23485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.045057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54671 (local address 127.17.132.2:45987)
0811 01:38:03.045251 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.045258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.045387 (+ 129us) server_negotiation.cc:407] Connection header received
0811 01:38:03.045650 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.045660 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.045728 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.045875 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.047084 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.047088 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.047091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.047110 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.047145 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.047156 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.047347 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.047625 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.047684 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:38:03.048014 23470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.045059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:45987 (local address 127.17.132.3:54671)
0811 01:38:03.045277 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.045297 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:03.045419 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:03.045901 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:03.045906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:03.045931 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:03.046748 (+ 817us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:03.046750 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:03.046771 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:03.046836 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:03.047429 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:03.047439 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:03.047448 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:38:03.047635 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 01:38:03.047698 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 01:38:03.048614 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.045271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54491 (local address 127.17.132.1:35663)
0811 01:38:03.045444 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.045450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.046173 (+ 723us) server_negotiation.cc:407] Connection header received
0811 01:38:03.046383 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.046390 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.046458 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.046572 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.047865 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.047871 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.047875 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.047918 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.047956 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.047974 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.048131 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.048316 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.048395 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 01:38:03.049319 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.045081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.17.132.3:54491)
0811 01:38:03.045954 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.045984 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:03.046112 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:03.046689 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:03.046697 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:03.046725 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:03.047617 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:03.047621 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:03.047640 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:03.047694 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:03.048104 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:03.048110 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:03.048117 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:38:03.048902 (+ 785us) client_negotiation.cc:240] Negotiation successful
0811 01:38:03.048950 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"mutex_wait_us":200,"thread_start_us":341,"threads_started":1}
I20260811 01:38:03.049214 23275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c70714e0fda64a9f908a21b5b2c0c6ef" candidate_uuid: "073de7658f754742ade81d419ca47082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" is_pre_election: true
I20260811 01:38:03.049757 23275 raft_consensus.cc:2454] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073de7658f754742ade81d419ca47082 in term 0.
I20260811 01:38:03.050596 23346 leader_election.cc:302] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073de7658f754742ade81d419ca47082, 7cbfdeca5d624a3fa5930749d77cfd9c; no voters:
I20260811 01:38:03.050480 23135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c70714e0fda64a9f908a21b5b2c0c6ef" candidate_uuid: "073de7658f754742ade81d419ca47082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6896a6399eb49c994743fdfe7140114" is_pre_election: true
I20260811 01:38:03.051030 23496 raft_consensus.cc:2781] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:03.051107 23135 raft_consensus.cc:2454] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073de7658f754742ade81d419ca47082 in term 0.
I20260811 01:38:03.051234 23496 raft_consensus.cc:482] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:03.051342 23496 raft_consensus.cc:3037] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:03.054032 23496 raft_consensus.cc:504] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:03.054733 23496 leader_election.cc:288] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [CANDIDATE]: Term 1 election: Requested vote from peers 7cbfdeca5d624a3fa5930749d77cfd9c (127.17.132.2:45987), e6896a6399eb49c994743fdfe7140114 (127.17.132.1:35663)
I20260811 01:38:03.055394 23275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c70714e0fda64a9f908a21b5b2c0c6ef" candidate_uuid: "073de7658f754742ade81d419ca47082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c"
I20260811 01:38:03.055394 23135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c70714e0fda64a9f908a21b5b2c0c6ef" candidate_uuid: "073de7658f754742ade81d419ca47082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6896a6399eb49c994743fdfe7140114"
I20260811 01:38:03.055646 23275 raft_consensus.cc:3037] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:03.055646 23135 raft_consensus.cc:3037] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:38:03.058732 23469 tablet.cc:2369] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:03.059388 23135 raft_consensus.cc:2454] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073de7658f754742ade81d419ca47082 in term 1.
I20260811 01:38:03.059393 23275 raft_consensus.cc:2454] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073de7658f754742ade81d419ca47082 in term 1.
I20260811 01:38:03.059932 23346 leader_election.cc:302] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073de7658f754742ade81d419ca47082, 7cbfdeca5d624a3fa5930749d77cfd9c; no voters:
I20260811 01:38:03.060263 23496 raft_consensus.cc:2781] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:03.060783 23496 raft_consensus.cc:686] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 1 LEADER]: Becoming Leader. State: Replica: 073de7658f754742ade81d419ca47082, State: Running, Role: LEADER
I20260811 01:38:03.061244 23496 consensus_queue.cc:237] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } }
I20260811 01:38:03.066591 22984 catalog_manager.cc:5495] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073de7658f754742ade81d419ca47082 (127.17.132.3). New cstate: current_term: 1 leader_uuid: "073de7658f754742ade81d419ca47082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "073de7658f754742ade81d419ca47082" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 } health_report { overall_health: UNKNOWN } } }
W20260811 01:38:03.069191 23327 tablet.cc:2369] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:38:03.070951 23183 tablet.cc:2369] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:03.080461 23483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.078428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43416 (local address 127.17.132.3:43115)
0811 01:38:03.078601 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.078605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.078625 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:38:03.078831 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.078835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.078915 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.079002 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.079861 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.079865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.079868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.079883 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.079915 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.079927 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.080025 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.080213 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.080276 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:38:03.088989 23135 raft_consensus.cc:1261] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114 [term 1 FOLLOWER]: Refusing update from remote peer 073de7658f754742ade81d419ca47082: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:03.089001 23275 raft_consensus.cc:1261] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 1 FOLLOWER]: Refusing update from remote peer 073de7658f754742ade81d419ca47082: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:03.090077 23500 consensus_queue.cc:1035] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cbfdeca5d624a3fa5930749d77cfd9c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:03.090507 23496 consensus_queue.cc:1035] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6896a6399eb49c994743fdfe7140114" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:03.102298 23504 mvcc.cc:205] Tried to move back new op lower bound from 7317144711522435072 to 7317144711422922752. Current Snapshot: MvccSnapshot[applied={T|T < 7317144711522435072}]
I20260811 01:38:03.103458 23505 mvcc.cc:205] Tried to move back new op lower bound from 7317144711522435072 to 7317144711422922752. Current Snapshot: MvccSnapshot[applied={T|T < 7317144711522435072}]
I20260811 01:38:03.116273 22983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:03.116626 22983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:03.120659 22983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1862b9f766084af39d4a8a5880e7eccc: Sending DeleteTablet for 3 replicas of tablet c70714e0fda64a9f908a21b5b2c0c6ef
I20260811 01:38:03.122010 23397 tablet_service.cc:1514] Processing DeleteTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:03 UTC) from {username='slave'} at 127.0.0.1:43414
I20260811 01:38:03.122002 23254 tablet_service.cc:1514] Processing DeleteTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:03 UTC) from {username='slave'} at 127.0.0.1:48598
I20260811 01:38:03.122223 23113 tablet_service.cc:1514] Processing DeleteTablet for tablet c70714e0fda64a9f908a21b5b2c0c6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:03 UTC) from {username='slave'} at 127.0.0.1:36774
I20260811 01:38:03.124686 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23046
I20260811 01:38:03.137826 23517 tablet_replica.cc:330] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: stopping tablet replica
I20260811 01:38:03.138595 23517 raft_consensus.cc:2229] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:03.139281 23517 raft_consensus.cc:2258] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:03.142164 23517 ts_tablet_manager.cc:1905] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:03.151571 23517 ts_tablet_manager.cc:1918] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:03.151842 23517 log.cc:1196] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/c70714e0fda64a9f908a21b5b2c0c6ef
I20260811 01:38:03.152907 23517 ts_tablet_manager.cc:1939] T c70714e0fda64a9f908a21b5b2c0c6ef P 7cbfdeca5d624a3fa5930749d77cfd9c: Deleting consensus metadata
I20260811 01:38:03.154126 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.126592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36784 (local address 127.17.132.1:35663)
0811 01:38:03.126842 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.126851 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.150403 (+ 23552us) server_negotiation.cc:407] Connection header received
0811 01:38:03.150920 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.150926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.151060 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.151153 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.152824 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.152829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.152834 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.152857 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.152902 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.152921 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.153050 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.153490 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.153598 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:38:03.155164 22966 catalog_manager.cc:4841] TS 7cbfdeca5d624a3fa5930749d77cfd9c (127.17.132.2:45987): tablet c70714e0fda64a9f908a21b5b2c0c6ef (table test-table [id=90bb5ce0f69f4fe88becbbb7d662c5ce]) successfully deleted
I20260811 01:38:03.155519 23177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:03.158741 23515 tablet_replica.cc:330] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: stopping tablet replica
I20260811 01:38:03.159287 23515 raft_consensus.cc:2229] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:03.160142 23515 raft_consensus.cc:2258] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:03.162451 23515 ts_tablet_manager.cc:1905] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:03.171619 23515 ts_tablet_manager.cc:1918] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:03.171911 23515 log.cc:1196] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/c70714e0fda64a9f908a21b5b2c0c6ef
I20260811 01:38:03.172602 23515 ts_tablet_manager.cc:1939] T c70714e0fda64a9f908a21b5b2c0c6ef P 073de7658f754742ade81d419ca47082: Deleting consensus metadata
I20260811 01:38:03.174881 22970 catalog_manager.cc:4841] TS 073de7658f754742ade81d419ca47082 (127.17.132.3:43115): tablet c70714e0fda64a9f908a21b5b2c0c6ef (table test-table [id=90bb5ce0f69f4fe88becbbb7d662c5ce]) successfully deleted
I20260811 01:38:03.249645 23519 tablet_replica.cc:330] T c70714e0fda64a9f908a21b5b2c0c6ef P e6896a6399eb49c994743fdfe7140114: stopping tablet replica
I20260811 01:38:03.250023 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23046
I20260811 01:38:03.273175 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23186
W20260811 01:38:03.273276 22968 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:35663 (error 108)
I20260811 01:38:03.275352 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.274799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36788)
0811 01:38:03.274983 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.275134 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 01:38:03.275602 22968 catalog_manager.cc:4584] TS e6896a6399eb49c994743fdfe7140114 (127.17.132.1:35663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c70714e0fda64a9f908a21b5b2c0c6ef: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
I20260811 01:38:03.276976 23485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.274111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48612 (local address 127.17.132.2:45987)
0811 01:38:03.274320 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.274328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.275018 (+ 690us) server_negotiation.cc:407] Connection header received
0811 01:38:03.275106 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.275111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.275231 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.275347 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.276317 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.276324 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.276329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.276350 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.276393 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.276410 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.276534 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.276634 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.276694 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:38:03.277873 23321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:03.329934 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.329292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36798)
0811 01:38:03.329568 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.329683 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 01:38:03.331174 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.330757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36802)
0811 01:38:03.330933 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.331022 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:38:03.371408 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23186
I20260811 01:38:03.391724 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.391240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36810)
0811 01:38:03.391461 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.391557 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 01:38:03.393029 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.392639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36824)
0811 01:38:03.392819 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.392903 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 01:38:03.404315 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23329
I20260811 01:38:03.407718 23483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.405257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.17.132.3:43115)
0811 01:38:03.405467 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:03.405473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:03.405498 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:38:03.405690 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:03.405697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:03.405774 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:03.405930 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:03.406949 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:03.406955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:03.406960 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:03.406979 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:03.407020 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:03.407036 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:03.407184 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:03.407295 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 01:38:03.407368 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:38:03.408564 23463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:03.473960 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.473291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36834)
0811 01:38:03.473586 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.473696 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 01:38:03.475219 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.474779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36840)
0811 01:38:03.474984 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.475083 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 01:38:03.532868 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23329
I20260811 01:38:03.555225 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 22949
I20260811 01:38:03.556569 23015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:03.666486 23482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:03.665882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35663 (local address 127.0.0.1:36842)
0811 01:38:03.666122 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:03.666264 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 01:38:03.666810 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 22949
2026-08-11T01:38:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2964 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 01:38:03.718813 17936 mini_oidc.cc:152] Starting JWKS server
I20260811 01:38:03.722106 17936 webserver.cc:460] Webserver started at https://127.0.0.1:46135/ using document root <none> and password file <none>
I20260811 01:38:03.722509 17936 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:38:03.723286 17936 webserver.cc:460] Webserver started at http://127.0.0.1:42319/ using document root <none> and password file <none>
2026-08-11T01:38:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:03Z Disabled control of system clock
I20260811 01:38:03.760665 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:33887
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:36089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:33887
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46135/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/testchainca.cert with env {}
W20260811 01:38:04.108151 23531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:04.108554 23531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:04.108732 23531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:04.116454 23531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:04.116622 23531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:04.116712 23531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:04.116827 23531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:04.116914 23531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:38:04.117009 23531 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:38:04.117106 23531 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46135/jwks.json
I20260811 01:38:04.127959 23531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:33887
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:33887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46135/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:04.129408 23531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:04.130828 23531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:04.143819 23537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:04.143780 23538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:04.143859 23540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:04.144910 23531 server_base.cc:1034] running on GCE node
I20260811 01:38:04.145845 23531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:04.147368 23531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:04.148633 23531 hybrid_clock.cc:648] HybridClock initialized: now 1786412284148587 us; error 36 us; skew 500 ppm
I20260811 01:38:04.149055 23531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:04.151659 23531 webserver.cc:460] Webserver started at http://127.17.132.62:44943/ using document root <none> and password file <none>
I20260811 01:38:04.152426 23531 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:04.152572 23531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:04.152908 23531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:04.156168 23531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "b80bff0dba714b1ca4c75ebc6174e258"
format_stamp: "Formatted at 2026-08-11 01:38:04 on dist-test-slave-0kls"
server_key: "36970b816af0bd7f2384a3c42ff8d79f"
server_key_iv: "53c4a23675eafe39aabfa60428a1d8a1"
server_key_version: "encryptionkey@0"
I20260811 01:38:04.157174 23531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "b80bff0dba714b1ca4c75ebc6174e258"
format_stamp: "Formatted at 2026-08-11 01:38:04 on dist-test-slave-0kls"
server_key: "36970b816af0bd7f2384a3c42ff8d79f"
server_key_iv: "53c4a23675eafe39aabfa60428a1d8a1"
server_key_version: "encryptionkey@0"
I20260811 01:38:04.163367 23531 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 01:38:04.167382 23546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:04.169106 23531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:04.169338 23531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "b80bff0dba714b1ca4c75ebc6174e258"
format_stamp: "Formatted at 2026-08-11 01:38:04 on dist-test-slave-0kls"
server_key: "36970b816af0bd7f2384a3c42ff8d79f"
server_key_iv: "53c4a23675eafe39aabfa60428a1d8a1"
server_key_version: "encryptionkey@0"
I20260811 01:38:04.169615 23531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:04.190181 23531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:04.191187 23531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:04.191582 23531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:04.212041 23531 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:33887
I20260811 01:38:04.212102 23602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:33887 every 8 connection(s)
I20260811 01:38:04.213635 23531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:04.216498 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23531
I20260811 01:38:04.216710 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:04.217577 17936 external_mini_cluster.cc:1428] Setting key 1cbd21ab40da975509ae89ee05d2fdb5
I20260811 01:38:04.218529 23603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:04.232933 23603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258: Bootstrap starting.
I20260811 01:38:04.233229 23606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:04.219707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43200 (local address 127.17.132.62:33887)
0811 01:38:04.220789 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:04.220801 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:04.220843 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:38:04.223294 (+ 2451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:04.223317 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:04.223876 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:04.224234 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:04.224916 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.226395 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.228361 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.229094 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.229245 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:04.230646 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:04.230655 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:04.230670 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:04.231323 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:04.231400 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:04.231422 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:04.231521 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:04.231769 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 01:38:04.232166 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":436,"threads_started":1}
I20260811 01:38:04.236505 23603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:04.237489 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:38:04.237805 23603 log.cc:824] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:04.241106 23603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258: No bootstrap required, opened a new log
I20260811 01:38:04.249699 23603 raft_consensus.cc:348] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } }
I20260811 01:38:04.250252 23603 raft_consensus.cc:374] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:04.250365 23603 raft_consensus.cc:729] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80bff0dba714b1ca4c75ebc6174e258, State: Initialized, Role: FOLLOWER
I20260811 01:38:04.251010 23603 consensus_queue.cc:260] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } }
I20260811 01:38:04.251262 23603 raft_consensus.cc:388] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:04.251426 23603 raft_consensus.cc:482] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:04.251623 23603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:04.254102 23603 raft_consensus.cc:504] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } }
I20260811 01:38:04.254801 23603 leader_election.cc:302] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b80bff0dba714b1ca4c75ebc6174e258; no voters:
I20260811 01:38:04.255537 23603 leader_election.cc:288] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:04.255664 23608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:04.256451 23608 raft_consensus.cc:686] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [term 1 LEADER]: Becoming Leader. State: Replica: b80bff0dba714b1ca4c75ebc6174e258, State: Running, Role: LEADER
I20260811 01:38:04.257031 23608 consensus_queue.cc:237] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } }
I20260811 01:38:04.257894 23603 sys_catalog.cc:564] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:04.260036 23610 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b80bff0dba714b1ca4c75ebc6174e258. Latest consensus state: current_term: 1 leader_uuid: "b80bff0dba714b1ca4c75ebc6174e258" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } } }
I20260811 01:38:04.259938 23609 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b80bff0dba714b1ca4c75ebc6174e258" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80bff0dba714b1ca4c75ebc6174e258" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 33887 } } }
I20260811 01:38:04.260485 23610 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:04.260509 23609 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:04.262822 23618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:04.268522 23618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:04.278719 23618 catalog_manager.cc:1347] Generated new cluster ID: 3d5c61ad4c8943fb8ec0229f1fa86a4f
I20260811 01:38:04.278865 23618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:04.309515 23618 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:04.311625 23618 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:04.339701 23618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b80bff0dba714b1ca4c75ebc6174e258: Generated new TSK 0
I20260811 01:38:04.340942 23618 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:38:04.392629 23638 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 01:38:04.392907 23638 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:38:04.396739 23606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:04.368376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.17.132.62:33887)
0811 01:38:04.368604 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:04.368612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:04.369287 (+ 675us) server_negotiation.cc:407] Connection header received
0811 01:38:04.369682 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:04.369688 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:04.369821 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:04.369983 (+ 162us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:38:04.370629 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.371812 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.373743 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.374530 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.374673 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:04.375562 (+ 889us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:38:04.395926 (+ 20364us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:38:04.396395 (+ 469us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43208: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":83}
W20260811 01:38:04.396893 23606 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43208: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 01:38:04.398782 23637 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:04.368266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:33887 (local address 127.0.0.1:43208)
0811 01:38:04.369160 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:04.369180 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:04.369357 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:04.370068 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:04.370072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:04.370083 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:38:04.370443 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:04.370451 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.372056 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.372061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:04.373489 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:04.373506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:04.374839 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:04.374845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:04.375107 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:04.375191 (+ 84us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:38:04.396355 (+ 21164us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:38:04.396702 (+ 347us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.132.62:33887: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":475,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.132.62:33887: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46135/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 01:38:04.402078 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23531
I20260811 01:38:04.403445 23597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:04.504667 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23531
2026-08-11T01:38:04Z chronyd exiting
I20260811 01:38:04.560088 17936 test_util.cc:175] -----------------------------------------------
I20260811 01:38:04.560226 17936 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786412236095684-17936-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (851 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 01:38:04.564215 17936 mini_oidc.cc:152] Starting JWKS server
I20260811 01:38:04.566299 17936 webserver.cc:460] Webserver started at https://127.0.0.1:41959/ using document root <none> and password file <none>
I20260811 01:38:04.566592 17936 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:38:04.567379 17936 webserver.cc:460] Webserver started at http://127.0.0.1:36157/ using document root <none> and password file <none>
2026-08-11T01:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:04Z Disabled control of system clock
I20260811 01:38:04.606529 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34565
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34565
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41959/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/testchainca.cert with env {}
W20260811 01:38:04.969318 23646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:04.969746 23646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:04.969928 23646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:04.977653 23646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:04.977855 23646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:04.977959 23646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:04.978076 23646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:04.978164 23646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:38:04.978276 23646 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:38:04.978355 23646 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41959/jwks.json
I20260811 01:38:04.989271 23646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41959/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:04.990849 23646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:04.992443 23646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:05.007103 23657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:05.007141 23654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:05.008675 23653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:05.008623 23646 server_base.cc:1034] running on GCE node
I20260811 01:38:05.009716 23646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:05.012496 23646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:05.013834 23646 hybrid_clock.cc:648] HybridClock initialized: now 1786412285013727 us; error 79 us; skew 500 ppm
I20260811 01:38:05.014345 23646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:05.018021 23646 webserver.cc:460] Webserver started at http://127.17.132.62:39165/ using document root <none> and password file <none>
I20260811 01:38:05.019085 23646 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:05.019229 23646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:05.019675 23646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:05.024159 23646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "12e7a831659240d0ae7815ba32a1b075"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "e824f44a8c8aa963ffe78df1dde10ff3"
server_key_iv: "26887809a6bfaf4d70778f35f37e2488"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.025699 23646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "12e7a831659240d0ae7815ba32a1b075"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "e824f44a8c8aa963ffe78df1dde10ff3"
server_key_iv: "26887809a6bfaf4d70778f35f37e2488"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.034377 23646 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260811 01:38:05.038621 23663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:05.040618 23646 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:38:05.040917 23646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "12e7a831659240d0ae7815ba32a1b075"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "e824f44a8c8aa963ffe78df1dde10ff3"
server_key_iv: "26887809a6bfaf4d70778f35f37e2488"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.041222 23646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:05.067072 23646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:05.068125 23646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:05.068534 23646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:05.089654 23646 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34565
I20260811 01:38:05.089701 23717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34565 every 8 connection(s)
I20260811 01:38:05.091207 23646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:05.094692 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23646
I20260811 01:38:05.094970 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:05.095817 17936 external_mini_cluster.cc:1428] Setting key c20ede60a6a08349d5cda7dbf7cb25d9
I20260811 01:38:05.096038 23718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:05.110538 23718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075: Bootstrap starting.
I20260811 01:38:05.110978 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:05.098032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39368 (local address 127.17.132.62:34565)
0811 01:38:05.099146 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:05.099158 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:05.099205 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:38:05.101154 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:05.101178 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:05.101733 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:05.102302 (+ 569us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:05.102956 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.104445 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.105928 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.106712 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.106968 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:05.108323 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:05.108331 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:05.108348 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:05.108931 (+ 583us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:05.109016 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:05.109039 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:05.109190 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:05.109436 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 01:38:05.109840 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":410,"threads_started":1}
I20260811 01:38:05.114910 23718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:05.115875 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:38:05.116401 23718 log.cc:824] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:05.120153 23718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075: No bootstrap required, opened a new log
I20260811 01:38:05.128082 23718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } }
I20260811 01:38:05.128505 23718 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:05.128577 23718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e7a831659240d0ae7815ba32a1b075, State: Initialized, Role: FOLLOWER
I20260811 01:38:05.129324 23718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } }
I20260811 01:38:05.129628 23718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:05.129843 23718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:05.130067 23718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:05.132393 23718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } }
I20260811 01:38:05.132892 23718 leader_election.cc:302] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e7a831659240d0ae7815ba32a1b075; no voters:
I20260811 01:38:05.133538 23718 leader_election.cc:288] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:05.133754 23723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:05.134604 23723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [term 1 LEADER]: Becoming Leader. State: Replica: 12e7a831659240d0ae7815ba32a1b075, State: Running, Role: LEADER
I20260811 01:38:05.135192 23723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } }
I20260811 01:38:05.135964 23718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:05.138149 23725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12e7a831659240d0ae7815ba32a1b075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } } }
I20260811 01:38:05.138095 23726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e7a831659240d0ae7815ba32a1b075. Latest consensus state: current_term: 1 leader_uuid: "12e7a831659240d0ae7815ba32a1b075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e7a831659240d0ae7815ba32a1b075" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34565 } } }
I20260811 01:38:05.138564 23725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:05.138568 23726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:05.139946 23731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:05.147112 23731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:05.157405 23731 catalog_manager.cc:1347] Generated new cluster ID: 9d8f99d8c2874ab29ecae8a0d44ae04d
I20260811 01:38:05.157567 23731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:05.168220 23731 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:05.170181 23731 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:05.185395 23731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12e7a831659240d0ae7815ba32a1b075: Generated new TSK 0
I20260811 01:38:05.186594 23731 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:38:05.230813 23751 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 01:38:05.230973 23751 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:38:05.232322 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:05.211255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.17.132.62:34565)
0811 01:38:05.211491 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:05.211499 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:05.211962 (+ 463us) server_negotiation.cc:407] Connection header received
0811 01:38:05.212184 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:05.212190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:05.212297 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:05.212481 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:38:05.213011 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.214193 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.215674 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.216407 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.216538 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:05.217098 (+ 560us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:38:05.231546 (+ 14448us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41959/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:38:05.231967 (+ 421us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41959/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 01:38:05.232435 23750 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:05.211095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34565 (local address 127.0.0.1:39384)
0811 01:38:05.211849 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:05.211870 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:05.211998 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:05.212559 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:05.212563 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:05.212574 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:38:05.212847 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:05.212855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.214374 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.214379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:05.215511 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:05.215531 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.216614 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.216619 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:05.216761 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:05.216805 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:38:05.231822 (+ 15017us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41959/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:38:05.232097 (+ 275us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.132.62:34565: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41959/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":430,"threads_started":1}
W20260811 01:38:05.232465 23721 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41959/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 01:38:05.233896 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23646
I20260811 01:38:05.235240 23713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:05.331487 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23646
2026-08-11T01:38:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (827 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 01:38:05.391393 17936 mini_oidc.cc:152] Starting JWKS server
I20260811 01:38:05.393393 17936 webserver.cc:460] Webserver started at https://127.0.0.1:43043/ using document root <none> and password file <none>
I20260811 01:38:05.393668 17936 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:38:05.394439 17936 webserver.cc:460] Webserver started at http://127.0.0.1:37691/ using document root <none> and password file <none>
2026-08-11T01:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:05Z Disabled control of system clock
I20260811 01:38:05.431378 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45219
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:45511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:45219
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43043/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:38:05.783249 23759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:05.783663 23759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:05.783828 23759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:05.791451 23759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:05.791666 23759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:05.791762 23759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:05.791869 23759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:05.791955 23759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:38:05.792090 23759 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:38:05.792402 23759 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43043/jwks.json
I20260811 01:38:05.802903 23759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:45511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:45219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43043/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:05.804359 23759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:05.806406 23759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:05.819444 23764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:05.819530 23767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:05.819551 23765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:05.820608 23759 server_base.cc:1034] running on GCE node
I20260811 01:38:05.821458 23759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:05.823144 23759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:05.824429 23759 hybrid_clock.cc:648] HybridClock initialized: now 1786412285824344 us; error 63 us; skew 500 ppm
I20260811 01:38:05.824820 23759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:05.832448 23759 webserver.cc:460] Webserver started at http://127.17.132.62:43315/ using document root <none> and password file <none>
I20260811 01:38:05.833283 23759 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:05.833436 23759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:05.833849 23759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:05.837013 23759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "36f42ac0a4e74243a8ddc8db7af81328"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "d2140261c126e596396b6145d13f381b"
server_key_iv: "ca456e4daf0632a2645d7027dc56d05f"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.838028 23759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "36f42ac0a4e74243a8ddc8db7af81328"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "d2140261c126e596396b6145d13f381b"
server_key_iv: "ca456e4daf0632a2645d7027dc56d05f"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.843739 23759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:38:05.847713 23773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:05.849285 23759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:05.849521 23759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "36f42ac0a4e74243a8ddc8db7af81328"
format_stamp: "Formatted at 2026-08-11 01:38:05 on dist-test-slave-0kls"
server_key: "d2140261c126e596396b6145d13f381b"
server_key_iv: "ca456e4daf0632a2645d7027dc56d05f"
server_key_version: "encryptionkey@0"
I20260811 01:38:05.849771 23759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:05.881925 23759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:05.883044 23759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:05.883445 23759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:05.903385 23759 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:45219
I20260811 01:38:05.903393 23833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:45219 every 8 connection(s)
I20260811 01:38:05.904973 23759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:05.908351 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23759
I20260811 01:38:05.908576 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:05.909451 17936 external_mini_cluster.cc:1428] Setting key f83e284beb0ccfbc13414b6ffb151231
I20260811 01:38:05.909698 23834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:05.923978 23834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328: Bootstrap starting.
I20260811 01:38:05.925546 23838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:05.911567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52892 (local address 127.17.132.62:45219)
0811 01:38:05.912684 (+ 1117us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:05.912697 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:05.912745 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:38:05.914909 (+ 2164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:05.914935 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:05.915493 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:05.915956 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:05.916612 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.918064 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.919582 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:05.920350 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:05.920607 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:05.921984 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:05.921993 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:05.922011 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:05.923513 (+ 1502us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:05.923609 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:05.923637 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:05.923806 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:05.924072 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 01:38:05.924490 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":413,"threads_started":1}
I20260811 01:38:05.927978 23834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:05.929339 23834 log.cc:824] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:05.930486 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:38:05.933215 23834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328: No bootstrap required, opened a new log
I20260811 01:38:05.941285 23834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } }
I20260811 01:38:05.941819 23834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:05.941958 23834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f42ac0a4e74243a8ddc8db7af81328, State: Initialized, Role: FOLLOWER
I20260811 01:38:05.942601 23834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } }
I20260811 01:38:05.942883 23834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:05.943053 23834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:05.943289 23834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:05.945715 23834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } }
I20260811 01:38:05.946410 23834 leader_election.cc:302] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36f42ac0a4e74243a8ddc8db7af81328; no voters:
I20260811 01:38:05.947139 23834 leader_election.cc:288] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:05.947360 23841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:05.949394 23841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [term 1 LEADER]: Becoming Leader. State: Replica: 36f42ac0a4e74243a8ddc8db7af81328, State: Running, Role: LEADER
I20260811 01:38:05.950162 23841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } }
I20260811 01:38:05.950562 23834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:05.953533 23843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36f42ac0a4e74243a8ddc8db7af81328" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } } }
I20260811 01:38:05.954015 23843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:05.956655 23844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36f42ac0a4e74243a8ddc8db7af81328. Latest consensus state: current_term: 1 leader_uuid: "36f42ac0a4e74243a8ddc8db7af81328" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36f42ac0a4e74243a8ddc8db7af81328" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45219 } } }
I20260811 01:38:05.957096 23844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:05.958964 23849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:05.964848 23849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:05.973888 23849 catalog_manager.cc:1347] Generated new cluster ID: dcac11a82daf446fad823adbb0311d0c
I20260811 01:38:05.974026 23849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:05.989274 23849 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:05.990738 23849 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:05.997922 23849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36f42ac0a4e74243a8ddc8db7af81328: Generated new TSK 0
I20260811 01:38:05.998858 23849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:06.030159 23838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:06.021302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.17.132.62:45219)
0811 01:38:06.021506 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:06.021512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:06.021923 (+ 411us) server_negotiation.cc:407] Connection header received
0811 01:38:06.022207 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:06.022213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:06.022328 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:06.022503 (+ 175us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:38:06.022984 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.024169 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.025570 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.026294 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.026426 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:06.026987 (+ 561us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:38:06.029439 (+ 2452us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:38:06.029811 (+ 372us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52902: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 01:38:06.030311 23838 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52902: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 01:38:06.031876 23868 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:06.021125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:45219 (local address 127.0.0.1:52902)
0811 01:38:06.021765 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:06.021828 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:06.021972 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:06.022520 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:06.022524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:06.022533 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:38:06.022801 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:06.022808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.024324 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.024328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:06.025412 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:06.025423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.026501 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.026506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:06.026644 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:06.026676 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:38:06.029663 (+ 2987us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:38:06.031440 (+ 1777us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.132.62:45219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43043/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":1445,"thread_start_us":346,"threads_started":1}
I20260811 01:38:06.033008 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23759
I20260811 01:38:06.034350 23828 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 01:38:06.045223 23869 webserver.cc:533] Webserver: sslize failed:
E20260811 01:38:06.045387 23869 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:38:06.131196 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23759
2026-08-11T01:38:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (799 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T01:38:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:06Z Disabled control of system clock
I20260811 01:38:06.228175 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:38947
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:38947
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/testchainca.cert with env {}
W20260811 01:38:06.593266 23874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:06.593609 23874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:06.593773 23874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:06.601585 23874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:06.601718 23874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:06.601797 23874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:06.601917 23874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:06.601958 23874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:38:06.602077 23874 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:38:06.602125 23874 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 01:38:06.612780 23874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:38947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:38947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:06.614332 23874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:06.615717 23874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:06.629063 23882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:06.629122 23884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:06.629151 23881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:06.630275 23874 server_base.cc:1034] running on GCE node
I20260811 01:38:06.631204 23874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:06.632822 23874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:06.634128 23874 hybrid_clock.cc:648] HybridClock initialized: now 1786412286634070 us; error 48 us; skew 500 ppm
I20260811 01:38:06.634536 23874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:06.637131 23874 webserver.cc:460] Webserver started at http://127.17.132.62:39069/ using document root <none> and password file <none>
I20260811 01:38:06.637980 23874 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:06.638134 23874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:06.638471 23874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:06.641530 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e34a93f71de54e378216dddb1de9fe9d"
format_stamp: "Formatted at 2026-08-11 01:38:06 on dist-test-slave-0kls"
server_key: "ea04ab658ffb66bf623dc27d5a9afbb9"
server_key_iv: "9300d8383a7e0a8b7423d9264fd4f018"
server_key_version: "encryptionkey@0"
I20260811 01:38:06.642441 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e34a93f71de54e378216dddb1de9fe9d"
format_stamp: "Formatted at 2026-08-11 01:38:06 on dist-test-slave-0kls"
server_key: "ea04ab658ffb66bf623dc27d5a9afbb9"
server_key_iv: "9300d8383a7e0a8b7423d9264fd4f018"
server_key_version: "encryptionkey@0"
I20260811 01:38:06.647805 23874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:38:06.651597 23890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:06.653108 23874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:38:06.653306 23874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e34a93f71de54e378216dddb1de9fe9d"
format_stamp: "Formatted at 2026-08-11 01:38:06 on dist-test-slave-0kls"
server_key: "ea04ab658ffb66bf623dc27d5a9afbb9"
server_key_iv: "9300d8383a7e0a8b7423d9264fd4f018"
server_key_version: "encryptionkey@0"
I20260811 01:38:06.653545 23874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:06.667351 23874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:06.668233 23874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:06.668542 23874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:06.688730 23874 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:38947
I20260811 01:38:06.688750 23944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:38947 every 8 connection(s)
I20260811 01:38:06.690275 23874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:06.694362 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 23874
I20260811 01:38:06.694628 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:06.694633 23945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:06.695473 17936 external_mini_cluster.cc:1428] Setting key c02e814fa5d14c954817e85770b0d193
I20260811 01:38:06.708928 23945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d: Bootstrap starting.
I20260811 01:38:06.709961 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:06.697618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.17.132.62:38947)
0811 01:38:06.698844 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:06.698856 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:06.698910 (+ 54us) server_negotiation.cc:407] Connection header received
0811 01:38:06.700530 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:06.700555 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:06.701117 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:06.701606 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:06.702301 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.703669 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.705024 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.705762 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.706048 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:06.707387 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:06.707394 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:06.707411 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:06.707994 (+ 583us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:06.708084 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:06.708106 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:06.708245 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:06.708487 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 01:38:06.708840 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":439,"threads_started":1}
I20260811 01:38:06.712844 23945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:06.714236 23945 log.cc:824] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:06.714332 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:38:06.717468 23945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d: No bootstrap required, opened a new log
I20260811 01:38:06.725857 23945 raft_consensus.cc:348] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } }
I20260811 01:38:06.726321 23945 raft_consensus.cc:374] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:06.726437 23945 raft_consensus.cc:729] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34a93f71de54e378216dddb1de9fe9d, State: Initialized, Role: FOLLOWER
I20260811 01:38:06.727183 23945 consensus_queue.cc:260] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } }
I20260811 01:38:06.727469 23945 raft_consensus.cc:388] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:06.727640 23945 raft_consensus.cc:482] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:06.727855 23945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:06.730221 23945 raft_consensus.cc:504] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } }
I20260811 01:38:06.730743 23945 leader_election.cc:302] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e34a93f71de54e378216dddb1de9fe9d; no voters:
I20260811 01:38:06.731357 23945 leader_election.cc:288] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:06.731557 23951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:06.732368 23951 raft_consensus.cc:686] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [term 1 LEADER]: Becoming Leader. State: Replica: e34a93f71de54e378216dddb1de9fe9d, State: Running, Role: LEADER
I20260811 01:38:06.732925 23951 consensus_queue.cc:237] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } }
I20260811 01:38:06.733657 23945 sys_catalog.cc:564] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:06.736649 23953 sys_catalog.cc:455] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e34a93f71de54e378216dddb1de9fe9d. Latest consensus state: current_term: 1 leader_uuid: "e34a93f71de54e378216dddb1de9fe9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } } }
I20260811 01:38:06.736689 23952 sys_catalog.cc:455] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e34a93f71de54e378216dddb1de9fe9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e34a93f71de54e378216dddb1de9fe9d" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38947 } } }
I20260811 01:38:06.737133 23953 sys_catalog.cc:458] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:06.737200 23952 sys_catalog.cc:458] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:06.738230 23956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:06.745247 23956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:06.755067 23956 catalog_manager.cc:1347] Generated new cluster ID: e0b8a869d4b641cfa47e9de49d439022
I20260811 01:38:06.755209 23956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:06.772079 23956 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:06.773468 23956 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:06.790468 23956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e34a93f71de54e378216dddb1de9fe9d: Generated new TSK 0
I20260811 01:38:06.791407 23956 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:07.268970 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:06.821253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47768 (local address 127.17.132.62:38947)
0811 01:38:06.821475 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:06.821483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:06.821941 (+ 458us) server_negotiation.cc:407] Connection header received
0811 01:38:06.822265 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:06.822272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:06.822385 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:06.822514 (+ 129us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:38:06.823135 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.824347 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.825957 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.826714 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.826854 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:06.827387 (+ 533us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:38:07.268339 (+440952us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:38:07.268710 (+ 371us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47768: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 01:38:07.269150 23949 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47768: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 01:38:07.269318 23977 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:06.821079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:38947 (local address 127.0.0.1:47768)
0811 01:38:06.821822 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:06.821845 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:06.822015 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:06.822718 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:06.822722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:06.822732 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:38:06.822973 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:06.822981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.824588 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.824595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:06.825741 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:06.825753 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:06.826901 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:06.826905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:06.827029 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:06.827065 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:38:07.268646 (+441581us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:38:07.268918 (+ 272us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.132.62:38947: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":900,"threads_started":1}
I20260811 01:38:07.271059 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 23874
I20260811 01:38:07.272176 23939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:07.381588 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 23874
2026-08-11T01:38:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1235 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (469 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (461 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:38:08 dist-test-slave-0kls krb5kdc[23993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:38:08 dist-test-slave-0kls krb5kdc[23993](info): set up 2 sockets
Aug 11 01:38:08 dist-test-slave-0kls krb5kdc[23993](info): commencing operation
krb5kdc: starting...
W20260811 01:38:09.493551 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:38:09 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:38:09.778870 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36503
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:10.136713 24008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:10.137101 24008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:10.137267 24008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:10.145064 24008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:10.145241 24008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:10.145360 24008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:10.145462 24008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:10.145543 24008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:10.156134 24008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:10.157613 24008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:10.159034 24008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:10.172375 24013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:10.172238 24017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:10.172255 24015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:10.173467 24008 server_base.cc:1034] running on GCE node
I20260811 01:38:10.174474 24008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:10.176067 24008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:10.177359 24008 hybrid_clock.cc:648] HybridClock initialized: now 1786412290177299 us; error 49 us; skew 500 ppm
I20260811 01:38:10.178011 24008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:10 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412290, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:10.181995 24008 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:38:10.183769 24008 webserver.cc:460] Webserver started at http://127.17.132.62:37783/ using document root <none> and password file <none>
I20260811 01:38:10.184638 24008 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:10.184813 24008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:10.185164 24008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:10.188789 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "c7cb231c894042c3aa5ee4a2c8121210"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "fde75a62d2fa10e5edbade2f7e87e9e8"
server_key_iv: "3e63db9a33547b1ee25d74d34b58c795"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.189690 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "c7cb231c894042c3aa5ee4a2c8121210"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "fde75a62d2fa10e5edbade2f7e87e9e8"
server_key_iv: "3e63db9a33547b1ee25d74d34b58c795"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.195819 24008 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:38:10.200008 24026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:10.201687 24008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:38:10.201947 24008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "c7cb231c894042c3aa5ee4a2c8121210"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "fde75a62d2fa10e5edbade2f7e87e9e8"
server_key_iv: "3e63db9a33547b1ee25d74d34b58c795"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.202189 24008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:10.240379 24008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:10.245318 24008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:10.245653 24008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:10.265571 24008 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:36503
I20260811 01:38:10.265623 24079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:36503 every 8 connection(s)
I20260811 01:38:10.267095 24008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:10.271112 24080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:10.276731 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24008
I20260811 01:38:10.276996 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:10.277830 17936 external_mini_cluster.cc:1428] Setting key d7cd7048f8d03acfc790f40554adc3c2
I20260811 01:38:10.283478 24080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210: Bootstrap starting.
I20260811 01:38:10.287469 24080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:10.288859 24080 log.cc:824] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:10.292876 24080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210: No bootstrap required, opened a new log
Aug 11 01:38:10 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:10.301932 24080 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } }
I20260811 01:38:10.302389 24080 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:10.302537 24080 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cb231c894042c3aa5ee4a2c8121210, State: Initialized, Role: FOLLOWER
I20260811 01:38:10.303272 24080 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } }
I20260811 01:38:10.303562 24080 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:10.303755 24080 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:10.303960 24080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:10.304407 24084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:10.280135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.17.132.62:36503)
0811 01:38:10.281128 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:10.281150 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:10.281200 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:38:10.283085 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:10.283111 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:10.283527 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:10.283954 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:10.285922 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.287261 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.289130 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.290297 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.290491 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:10.295540 (+ 5049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:10.295549 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:10.295569 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:10.295620 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:10.299107 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:10.299992 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:10.300000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:10.300008 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:10.300316 (+ 308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:10.300864 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:10.300872 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:10.300878 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:10.301675 (+ 797us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:10.302033 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:10.302558 (+ 525us) server_negotiation.cc:299] Negotiation successful
0811 01:38:10.303071 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":494,"threads_started":1}
I20260811 01:38:10.307212 24080 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } }
I20260811 01:38:10.307833 24080 leader_election.cc:302] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7cb231c894042c3aa5ee4a2c8121210; no voters:
I20260811 01:38:10.308463 24080 leader_election.cc:288] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:10.308605 24086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:10.309314 24086 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [term 1 LEADER]: Becoming Leader. State: Replica: c7cb231c894042c3aa5ee4a2c8121210, State: Running, Role: LEADER
I20260811 01:38:10.309880 24086 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } }
I20260811 01:38:10.310659 24080 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:10.312637 24087 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7cb231c894042c3aa5ee4a2c8121210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } } }
I20260811 01:38:10.313442 24087 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:10.313076 24088 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7cb231c894042c3aa5ee4a2c8121210. Latest consensus state: current_term: 1 leader_uuid: "c7cb231c894042c3aa5ee4a2c8121210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb231c894042c3aa5ee4a2c8121210" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36503 } } }
I20260811 01:38:10.318544 24088 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:10.320312 24092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:10.326648 24092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:10.336426 24092 catalog_manager.cc:1347] Generated new cluster ID: ebdc50cb0e674661a8884b9879d31b3e
I20260811 01:38:10.336570 24092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:10.348431 24092 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:10.350147 24092 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:10.363389 24092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7cb231c894042c3aa5ee4a2c8121210: Generated new TSK 0
I20260811 01:38:10.364343 24092 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:38:10.442636 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:10.819979 24108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:10.820304 24108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:10.820408 24108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:10.828169 24108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:10.828296 24108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:10.828413 24108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:10.838946 24108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:10.840341 24108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:10.841699 24108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:10.856074 24115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:10.856076 24116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:10.856093 24118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:10.859671 24108 server_base.cc:1034] running on GCE node
I20260811 01:38:10.860471 24108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:10.861583 24108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:10.862890 24108 hybrid_clock.cc:648] HybridClock initialized: now 1786412290862831 us; error 74 us; skew 500 ppm
I20260811 01:38:10.863355 24108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:10 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412290, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:10.871085 24108 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:38:10.873008 24108 webserver.cc:460] Webserver started at http://127.17.132.1:36759/ using document root <none> and password file <none>
I20260811 01:38:10.873924 24108 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:10.874092 24108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:10.874447 24108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:10.878299 24108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "d057f7043f5b424eac190bb97d26083d"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "a9887caecbad901f1621bbdc55d400b4"
server_key_iv: "6ebe83711ff451fcf09b667e20a12314"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.879443 24108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "d057f7043f5b424eac190bb97d26083d"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "a9887caecbad901f1621bbdc55d400b4"
server_key_iv: "6ebe83711ff451fcf09b667e20a12314"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.886706 24108 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 01:38:10.890942 24127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:10.892642 24108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:38:10.892884 24108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "d057f7043f5b424eac190bb97d26083d"
format_stamp: "Formatted at 2026-08-11 01:38:10 on dist-test-slave-0kls"
server_key: "a9887caecbad901f1621bbdc55d400b4"
server_key_iv: "6ebe83711ff451fcf09b667e20a12314"
server_key_version: "encryptionkey@0"
I20260811 01:38:10.893150 24108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:10.917944 24108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:10.922972 24108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:10.923329 24108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:10.924506 24108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:10.926054 24108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:10.926162 24108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:10.926316 24108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:10.926390 24108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:10.962141 24108 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:35733
I20260811 01:38:10.962216 24255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:35733 every 8 connection(s)
I20260811 01:38:10.963538 24108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:10.965396 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24108
I20260811 01:38:10.965646 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:10.966450 17936 external_mini_cluster.cc:1428] Setting key 83a25684e187ba353c0b91f67ffe2a9e
Aug 11 01:38:10 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412290, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:10.986030 24258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:10.966642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:52677 (local address 127.17.132.62:36503)
0811 01:38:10.967573 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:10.967579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:10.968354 (+ 775us) server_negotiation.cc:407] Connection header received
0811 01:38:10.970456 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:10.970461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:10.970567 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:10.970700 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:10.972340 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.973091 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.974797 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.975237 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.975380 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:10.979470 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:10.979475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:10.979478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:10.979513 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:10.982251 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:10.983391 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:10.983396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:10.983398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:10.983530 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:10.984031 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:10.984035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:10.984037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:10.984318 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:10.984494 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:10.985343 (+ 849us) server_negotiation.cc:299] Negotiation successful
0811 01:38:10.985605 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":670,"threads_started":1}
I20260811 01:38:10.987298 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:10.967348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36503 (local address 127.17.132.1:52677)
0811 01:38:10.968178 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:10.968235 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:10.970152 (+ 1917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:10.970963 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:10.970978 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:10.971545 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:10.972144 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:10.972163 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.973278 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.973282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:10.974637 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:10.974651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:10.975505 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:10.975513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:10.975757 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:10.976497 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:10.976528 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:10.979207 (+ 2679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:10.982463 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:10.982474 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:10.982500 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:10.983234 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:10.983656 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:10.983661 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:10.983665 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:10.983880 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:10.984475 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:10.984483 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:10.984923 (+ 440us) client_negotiation.cc:769] Sending connection context
0811 01:38:10.985225 (+ 302us) client_negotiation.cc:240] Negotiation successful
0811 01:38:10.985855 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":353,"threads_started":1}
I20260811 01:38:10.989323 24256 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36503
I20260811 01:38:10.989687 24256 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:10.990518 24256 heartbeater.cc:511] Master 127.17.132.62:36503 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:38:10.992964 24044 ts_manager.cc:194] Registered new tserver with Master: d057f7043f5b424eac190bb97d26083d (127.17.132.1:35733)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:38:10.994742 24044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:52677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:38:11.030053 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:11.392198 24262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:11.392499 24262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:11.392674 24262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:11.400431 24262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:11.400553 24262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:11.400735 24262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:11.411375 24262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:11.412839 24262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:11.414336 24262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:11.428436 24269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:11.428524 24268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:11.428503 24272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:11.429503 24262 server_base.cc:1034] running on GCE node
I20260811 01:38:11.430390 24262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:11.431463 24262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:11.432680 24262 hybrid_clock.cc:648] HybridClock initialized: now 1786412291432632 us; error 42 us; skew 500 ppm
I20260811 01:38:11.433112 24262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:11 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412291, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:11.436903 24262 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:38:11.438759 24262 webserver.cc:460] Webserver started at http://127.17.132.2:34601/ using document root <none> and password file <none>
I20260811 01:38:11.439594 24262 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:11.439775 24262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:11.440161 24262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:11.443692 24262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "559d1e02a00a4e23a1310e64906e1293"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "4be5c68428c1704679c23508c2f9fda1"
server_key_iv: "786a2393eecd1780df6de5040ec658c8"
server_key_version: "encryptionkey@0"
I20260811 01:38:11.444741 24262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "559d1e02a00a4e23a1310e64906e1293"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "4be5c68428c1704679c23508c2f9fda1"
server_key_iv: "786a2393eecd1780df6de5040ec658c8"
server_key_version: "encryptionkey@0"
I20260811 01:38:11.450809 24262 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:38:11.454609 24281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:11.456118 24262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:11.456310 24262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "559d1e02a00a4e23a1310e64906e1293"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "4be5c68428c1704679c23508c2f9fda1"
server_key_iv: "786a2393eecd1780df6de5040ec658c8"
server_key_version: "encryptionkey@0"
I20260811 01:38:11.456558 24262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:11.474273 24262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:11.479128 24262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:11.479470 24262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:11.480593 24262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:11.482168 24262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:11.482245 24262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:11.482391 24262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:11.482443 24262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:11.518702 24262 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:33985
I20260811 01:38:11.518743 24410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:33985 every 8 connection(s)
I20260811 01:38:11.520264 24262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:11.528589 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24262
I20260811 01:38:11.528887 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:11.529464 17936 external_mini_cluster.cc:1428] Setting key 61cfecae02eb5a6c53e81f22e8d3d78b
Aug 11 01:38:11 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412291, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:11.544591 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:11.523288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:54845 (local address 127.17.132.62:36503)
0811 01:38:11.523809 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:11.523817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:11.524872 (+ 1055us) server_negotiation.cc:407] Connection header received
0811 01:38:11.526866 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:11.526871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:11.526958 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:11.527066 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:11.528756 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:11.529924 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:11.532044 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:11.532761 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:11.532923 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:11.536896 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:11.536905 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:11.536913 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:11.536962 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:11.540730 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:11.541567 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:11.541574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:11.541580 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:11.541761 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:11.542453 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:11.542462 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:11.542466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:11.542923 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:11.543083 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:11.544080 (+ 997us) server_negotiation.cc:299] Negotiation successful
0811 01:38:11.544287 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":251,"threads_started":1}
I20260811 01:38:11.546335 24414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:11.523860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36503 (local address 127.17.132.2:54845)
0811 01:38:11.524687 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:11.524738 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:11.526561 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:11.527318 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:11.527327 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:11.527889 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:11.528539 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:11.528557 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:11.530207 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:11.530213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:11.531861 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:11.531878 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:11.533129 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:11.533139 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:11.533419 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:11.534224 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:11.534249 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:11.536617 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:11.540918 (+ 4301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:11.540926 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:11.540942 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:11.541421 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:11.541926 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:11.541931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:11.541934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:11.542275 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:11.543094 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:11.543105 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:11.543635 (+ 530us) client_negotiation.cc:769] Sending connection context
0811 01:38:11.543983 (+ 348us) client_negotiation.cc:240] Negotiation successful
0811 01:38:11.544645 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":318,"threads_started":1}
I20260811 01:38:11.548012 24411 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36503
I20260811 01:38:11.548383 24411 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:11.549223 24411 heartbeater.cc:511] Master 127.17.132.62:36503 requested a full tablet report, sending...
I20260811 01:38:11.551074 24044 ts_manager.cc:194] Registered new tserver with Master: 559d1e02a00a4e23a1310e64906e1293 (127.17.132.2:33985)
I20260811 01:38:11.551964 24044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:54845
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:38:11.594939 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:11.948951 24418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:11.949288 24418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:11.949386 24418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:11.956933 24418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:11.957065 24418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:11.957190 24418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:11.967669 24418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36503
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:11.968856 24418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:11.970216 24418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:11.983992 24425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:11.983932 24426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:11.983912 24428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:11.984731 24418 server_base.cc:1034] running on GCE node
I20260811 01:38:11.985463 24418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:11.986560 24418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:11.987799 24418 hybrid_clock.cc:648] HybridClock initialized: now 1786412291987750 us; error 43 us; skew 500 ppm
I20260811 01:38:11.988168 24418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:11 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412291, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:11.991484 24418 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:38:11.993026 24418 webserver.cc:460] Webserver started at http://127.17.132.3:41819/ using document root <none> and password file <none>
I20260811 01:38:11.993736 24418 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:11.993932 24418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:11.994272 24418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:11.997339 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "af0f8d05a20c47649bf96a9ebb24c309"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "20de11f21944cc75a0ede5141953ac29"
server_key_iv: "a127f2ac8de66e978410db655c35e187"
server_key_version: "encryptionkey@0"
I20260811 01:38:11.998242 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "af0f8d05a20c47649bf96a9ebb24c309"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "20de11f21944cc75a0ede5141953ac29"
server_key_iv: "a127f2ac8de66e978410db655c35e187"
server_key_version: "encryptionkey@0"
I20260811 01:38:11.999060 24256 heartbeater.cc:503] Master 127.17.132.62:36503 was elected leader, sending a full tablet report...
I20260811 01:38:12.007313 24418 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.007s
I20260811 01:38:12.011618 24435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:12.013303 24418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:12.013481 24418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "af0f8d05a20c47649bf96a9ebb24c309"
format_stamp: "Formatted at 2026-08-11 01:38:11 on dist-test-slave-0kls"
server_key: "20de11f21944cc75a0ede5141953ac29"
server_key_iv: "a127f2ac8de66e978410db655c35e187"
server_key_version: "encryptionkey@0"
I20260811 01:38:12.013684 24418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:12.033370 24418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:12.038064 24418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:12.038338 24418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:12.039301 24418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:12.040793 24418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:12.040889 24418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:12.040977 24418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:12.041024 24418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:12.077979 24418 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:45147
I20260811 01:38:12.078074 24563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:45147 every 8 connection(s)
I20260811 01:38:12.079365 24418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:12.082523 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24418
I20260811 01:38:12.082763 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:12.083330 17936 external_mini_cluster.cc:1428] Setting key 0af43bd8336ee65f8ac7cf3e33798603
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412291, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:12.101902 24566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.082142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:37205 (local address 127.17.132.62:36503)
0811 01:38:12.082686 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.082694 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.083950 (+ 1256us) server_negotiation.cc:407] Connection header received
0811 01:38:12.086448 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.086453 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.086536 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.086654 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.088390 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.089208 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.090881 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.091295 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.091399 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.095138 (+ 3739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.095143 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.095158 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.095195 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.098105 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.099263 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.099269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.099275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.099480 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.100196 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.100200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.100202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.100486 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.100624 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.101353 (+ 729us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.101526 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":251,"threads_started":1}
I20260811 01:38:12.102937 24567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.082766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36503 (local address 127.17.132.3:37205)
0811 01:38:12.083759 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:12.083819 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:12.086107 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:12.087021 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:12.087035 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:12.087606 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:12.088198 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:12.088217 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.089361 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.089368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:12.090738 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:12.090751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.091510 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.091515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:12.091743 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.092487 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:12.092517 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:12.094866 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:12.098353 (+ 3487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:12.098366 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:12.098387 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:12.099082 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:12.099674 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:12.099680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:12.099686 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:12.100048 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:12.100609 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:12.100616 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:12.100973 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 01:38:12.101258 (+ 285us) client_negotiation.cc:240] Negotiation successful
0811 01:38:12.101682 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":347,"threads_started":1}
I20260811 01:38:12.104395 24564 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36503
I20260811 01:38:12.104723 24564 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:12.105499 24564 heartbeater.cc:511] Master 127.17.132.62:36503 requested a full tablet report, sending...
I20260811 01:38:12.107100 24044 ts_manager.cc:194] Registered new tserver with Master: af0f8d05a20c47649bf96a9ebb24c309 (127.17.132.3:45147)
I20260811 01:38:12.107993 24044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:37205
I20260811 01:38:12.112676 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/test-admin.keytab.
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.147732 17936 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 01:38:12.153688 24572 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:12.150668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.17.132.1:35733)
0811 01:38:12.151500 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.151508 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.151538 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:38:12.151601 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.151617 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.151843 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.151988 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.153155 (+ 1167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57480: BlockingRecv error: recv got EOF from 127.0.0.1:57480 (error 108)
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":491,"threads_started":1}
W20260811 01:38:12.153998 17936 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.155781 17936 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.157327 17936 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:38:12.175428 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.159276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.17.132.1:35733)
0811 01:38:12.159523 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.159529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.159748 (+ 219us) server_negotiation.cc:407] Connection header received
0811 01:38:12.159996 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.160006 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.160100 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.160217 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.161397 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.162500 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.163758 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.164544 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.164897 (+ 353us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.168963 (+ 4066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.168979 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.168996 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.169037 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.172135 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.172920 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.172928 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.172931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.173079 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.173585 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.173597 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.173599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.174144 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.174414 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.174838 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.175131 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 01:38:12.182051 24572 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:12.179898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.17.132.1:35733)
0811 01:38:12.180168 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.180177 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.180506 (+ 329us) server_negotiation.cc:407] Connection header received
0811 01:38:12.180717 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.180729 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.180792 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.180898 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.181754 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57492: BlockingRecv error: recv got EOF from 127.0.0.1:57492 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 01:38:12.182263 17936 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.183857 17936 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.185253 17936 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:38:12.201114 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.186898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.17.132.1:35733)
0811 01:38:12.187144 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.187153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.187478 (+ 325us) server_negotiation.cc:407] Connection header received
0811 01:38:12.187696 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.187702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.187780 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.187888 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.188918 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.189643 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.190919 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.191366 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.191527 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.195329 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.195335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.195338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.195390 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.198321 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.199154 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.199159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.199161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.199294 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.199698 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.199704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.199707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.200016 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.200318 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.200599 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.200822 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260811 01:38:12.206563 24572 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:12.204279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.17.132.1:35733)
0811 01:38:12.204538 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.204544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.204781 (+ 237us) server_negotiation.cc:407] Connection header received
0811 01:38:12.205044 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.205048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.205132 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.205290 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.206291 (+ 1001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57500: BlockingRecv error: recv got EOF from 127.0.0.1:57500 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 01:38:12.206806 17936 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786412236095684-17936-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.208489 17936 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:12.210041 17936 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:38:12.228597 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.211628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57516 (local address 127.17.132.1:35733)
0811 01:38:12.211869 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.211878 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.212167 (+ 289us) server_negotiation.cc:407] Connection header received
0811 01:38:12.212381 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.212387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.212463 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.212568 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.213604 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.214428 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.215769 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.216228 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.216370 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.221114 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.221119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.221123 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.221165 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.224459 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.225546 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.225554 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.225558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.225756 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.226300 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.226306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.226310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.226758 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.227115 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.227944 (+ 829us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.228144 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:38:12.230419 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24108
I20260811 01:38:12.243582 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.231392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57520 (local address 127.17.132.1:35733)
0811 01:38:12.231565 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.231570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.231828 (+ 258us) server_negotiation.cc:407] Connection header received
0811 01:38:12.231966 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.231970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.232030 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.232114 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.233263 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.234056 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.235429 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.235858 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.235956 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.238251 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.238256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.238259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.238293 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.240764 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.241460 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.241467 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.241471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.241627 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.242057 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.242062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.242077 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.242363 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.242672 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.243006 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.243251 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:38:12.244599 24251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:12.338546 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24108
I20260811 01:38:12.358829 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24262
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:38:12.375847 24585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.359804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.17.132.2:33985)
0811 01:38:12.360443 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.360450 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.360475 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:38:12.360544 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.360551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.360762 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.360894 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.362039 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.363090 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.364315 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.364904 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.365008 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.369137 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.369151 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.369165 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.369207 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.372620 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.373516 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.373526 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.373530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.373674 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.374127 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.374132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.374135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.374525 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.374877 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.375210 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.375497 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":337,"threads_started":1}
I20260811 01:38:12.377261 24406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:12.464258 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24262
I20260811 01:38:12.486052 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24418
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[23993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:38:12.503338 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:12.487359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.17.132.3:45147)
0811 01:38:12.488039 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:12.488047 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:12.488079 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:12.488154 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:12.488160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:12.488372 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:12.488605 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:12.489947 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.491015 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.492358 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:12.492999 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:12.493156 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:12.497350 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:12.497364 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:12.497380 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:12.497423 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:12.500306 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.501059 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.501067 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.501070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.501207 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:12.501630 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:12.501636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:12.501639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:12.502088 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:12.502433 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:12.502729 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 01:38:12.503014 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":375,"threads_started":1}
I20260811 01:38:12.504712 24559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:12.593046 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24418
I20260811 01:38:12.614966 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24008
I20260811 01:38:12.616397 24075 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:12.722970 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24008
2026-08-11T01:38:12Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4411 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[24593](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[24593](info): set up 2 sockets
Aug 11 01:38:12 dist-test-slave-0kls krb5kdc[24593](info): commencing operation
krb5kdc: starting...
W20260811 01:38:13.891948 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:38:14 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:38:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:14Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab.
Entry for principal oryx/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab.
I20260811 01:38:14.206563 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40975
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab
--principal=oryx/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40975
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:14.567528 24606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:14.567863 24606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:14.568035 24606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:14.576107 24606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:14.576320 24606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:14.576416 24606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:14.576511 24606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:14.576588 24606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:14.588892 24606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab
--principal=oryx/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:14.590480 24606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:14.591924 24606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:14.605294 24613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:14.605255 24614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:14.605333 24618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:14.606490 24606 server_base.cc:1034] running on GCE node
I20260811 01:38:14.607393 24606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:14.609069 24606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:14.610335 24606 hybrid_clock.cc:648] HybridClock initialized: now 1786412294610276 us; error 47 us; skew 500 ppm
I20260811 01:38:14.610740 24606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:14 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:14.614384 24606 init.cc:377] Logged in from keytab as oryx/127.17.132.62@KRBTEST.COM (short username oryx)
I20260811 01:38:14.616199 24606 webserver.cc:460] Webserver started at http://127.17.132.62:38655/ using document root <none> and password file <none>
I20260811 01:38:14.616988 24606 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:14.617148 24606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:14.617492 24606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:14.620879 24606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "73c62fe0c43e4b1c8893cd499928a2a0"
format_stamp: "Formatted at 2026-08-11 01:38:14 on dist-test-slave-0kls"
server_key: "6a1f5bb83c3bf71ef090d8a1767f960c"
server_key_iv: "5d258bc4f2df32ed7b03a638faae474f"
server_key_version: "encryptionkey@0"
I20260811 01:38:14.621752 24606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "73c62fe0c43e4b1c8893cd499928a2a0"
format_stamp: "Formatted at 2026-08-11 01:38:14 on dist-test-slave-0kls"
server_key: "6a1f5bb83c3bf71ef090d8a1767f960c"
server_key_iv: "5d258bc4f2df32ed7b03a638faae474f"
server_key_version: "encryptionkey@0"
I20260811 01:38:14.627739 24606 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:38:14.631628 24625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:14.633279 24606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:14.633520 24606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "73c62fe0c43e4b1c8893cd499928a2a0"
format_stamp: "Formatted at 2026-08-11 01:38:14 on dist-test-slave-0kls"
server_key: "6a1f5bb83c3bf71ef090d8a1767f960c"
server_key_iv: "5d258bc4f2df32ed7b03a638faae474f"
server_key_version: "encryptionkey@0"
I20260811 01:38:14.633782 24606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:14.665462 24606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:14.670475 24606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:14.670866 24606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:14.692109 24606 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:40975
I20260811 01:38:14.692130 24680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:40975 every 8 connection(s)
I20260811 01:38:14.693616 24606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:14.696660 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24606
I20260811 01:38:14.696950 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:14.697813 17936 external_mini_cluster.cc:1428] Setting key 403571921611dd34dabaf28b5c55bc26
I20260811 01:38:14.698390 24681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:14.714380 24681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Bootstrap starting.
Aug 11 01:38:14 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:14.718528 24681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:14.719717 24681 log.cc:824] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:14.723055 24681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: No bootstrap required, opened a new log
I20260811 01:38:14.724159 24684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:14.700094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46884 (local address 127.17.132.62:40975)
0811 01:38:14.700964 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:14.700976 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:14.701019 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:38:14.703380 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:14.703406 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:14.703857 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:14.704250 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:14.706322 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:14.707683 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:14.709606 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:14.710517 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:14.710683 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:14.715734 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:14.715744 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:14.715760 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:14.715813 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:14.719555 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:14.720430 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:14.720437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:14.720444 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:14.720652 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:14.721071 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:14.721076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:14.721079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:14.721663 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:14.722031 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:14.722518 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 01:38:14.722997 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":402,"threads_started":1}
I20260811 01:38:14.732290 24681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } }
I20260811 01:38:14.732916 24681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:14.733067 24681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c62fe0c43e4b1c8893cd499928a2a0, State: Initialized, Role: FOLLOWER
I20260811 01:38:14.733932 24681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } }
I20260811 01:38:14.734206 24681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:14.734326 24681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:14.734462 24681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:14.736773 24681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } }
I20260811 01:38:14.737308 24681 leader_election.cc:302] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73c62fe0c43e4b1c8893cd499928a2a0; no voters:
I20260811 01:38:14.738003 24681 leader_election.cc:288] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:14.738174 24686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:14.739162 24686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 73c62fe0c43e4b1c8893cd499928a2a0, State: Running, Role: LEADER
I20260811 01:38:14.739722 24686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } }
I20260811 01:38:14.740502 24681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:14.743399 24688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73c62fe0c43e4b1c8893cd499928a2a0. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } }
I20260811 01:38:14.743419 24687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } }
I20260811 01:38:14.743906 24687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:14.743906 24688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:14.746315 24695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:14.751735 24695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:14.761130 24695 catalog_manager.cc:1347] Generated new cluster ID: 66ecc8464f0b4f7f97d8345b89369eeb
I20260811 01:38:14.761271 24695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:14.779023 24695 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:14.780493 24695 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:14.791047 24695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Generated new TSK 0
I20260811 01:38:14.792102 24695 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
I20260811 01:38:14.867301 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:15.241178 24709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:15.241545 24709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:15.241734 24709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:15.250109 24709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:15.250248 24709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:15.250368 24709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:15.260954 24709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:15.262471 24709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:15.263917 24709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:15.279676 24714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:15.279724 24717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:15.279680 24715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:15.281028 24709 server_base.cc:1034] running on GCE node
I20260811 01:38:15.282021 24709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:15.283310 24709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:15.284608 24709 hybrid_clock.cc:648] HybridClock initialized: now 1786412295284522 us; error 73 us; skew 500 ppm
I20260811 01:38:15.285055 24709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:15 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412295, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:15.288973 24709 init.cc:377] Logged in from keytab as oryx/127.17.132.1@KRBTEST.COM (short username oryx)
I20260811 01:38:15.291052 24709 webserver.cc:460] Webserver started at http://127.17.132.1:46099/ using document root <none> and password file <none>
I20260811 01:38:15.291893 24709 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:15.292058 24709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:15.292409 24709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:15.295783 24709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "ec9198d9aee977ce4617c3b14e105e8f"
server_key_iv: "5fb9aebfd64a7f26c1953fcaaf9fbafb"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.296640 24709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "ec9198d9aee977ce4617c3b14e105e8f"
server_key_iv: "5fb9aebfd64a7f26c1953fcaaf9fbafb"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.302546 24709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:38:15.306706 24726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.308228 24709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:15.308437 24709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "ec9198d9aee977ce4617c3b14e105e8f"
server_key_iv: "5fb9aebfd64a7f26c1953fcaaf9fbafb"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.308669 24709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:15.340723 24709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:15.345557 24709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:15.345935 24709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:15.347219 24709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:15.348802 24709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:15.348884 24709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.349040 24709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:15.349121 24709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.385341 24709 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:32777
I20260811 01:38:15.385407 24848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:32777 every 8 connection(s)
I20260811 01:38:15.386837 24709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:15.387964 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24709
I20260811 01:38:15.388312 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:15.389192 17936 external_mini_cluster.cc:1428] Setting key c6bbb2f384c35de46c3de99b643a74a5
Aug 11 01:38:15 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412295, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:15.413590 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:15.390157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:58785 (local address 127.17.132.62:40975)
0811 01:38:15.390653 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:15.390658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:15.392140 (+ 1482us) server_negotiation.cc:407] Connection header received
0811 01:38:15.395336 (+ 3196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:15.395343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:15.395444 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:15.395563 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:15.397948 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.398997 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.401774 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.402526 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.402699 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:15.406920 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:15.406926 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:15.406929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:15.406975 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:15.409916 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:15.410821 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:15.410827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:15.410829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:15.410966 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:15.411508 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:15.411512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:15.411514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:15.411807 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:15.411981 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:15.412907 (+ 926us) server_negotiation.cc:299] Negotiation successful
0811 01:38:15.413187 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":284,"threads_started":1}
I20260811 01:38:15.414814 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:15.390926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:58785)
0811 01:38:15.391946 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:15.392001 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:15.394982 (+ 2981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:15.395879 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:15.395894 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:15.396787 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:15.397710 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:15.397739 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.399192 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.399200 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:15.401553 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:15.401577 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.402840 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.402849 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:15.403236 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:15.404112 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:15.404139 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:15.406602 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:15.410102 (+ 3500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:15.410114 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:15.410143 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:15.410653 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:15.411099 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:15.411104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:15.411108 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:15.411361 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:15.411952 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:15.411962 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:15.412436 (+ 474us) client_negotiation.cc:769] Sending connection context
0811 01:38:15.412765 (+ 329us) client_negotiation.cc:240] Negotiation successful
0811 01:38:15.413388 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":416,"threads_started":1}
I20260811 01:38:15.416668 24849 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:15.417028 24849 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:38:15.418071 24849 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:15.420778 24643 ts_manager.cc:194] Registered new tserver with Master: e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.2@KRBTEST.COM" created.
I20260811 01:38:15.422629 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:58785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
I20260811 01:38:15.453311 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:15.820978 24855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:15.821267 24855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:15.821429 24855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:15.829020 24855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:15.829206 24855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:15.829396 24855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:15.840093 24855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:15.841727 24855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:15.843163 24855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:15.860523 24862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:15.860656 24860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:15.861452 24864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:15.861816 24855 server_base.cc:1034] running on GCE node
I20260811 01:38:15.862506 24855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:15.863580 24855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:15.864826 24855 hybrid_clock.cc:648] HybridClock initialized: now 1786412295864755 us; error 66 us; skew 500 ppm
I20260811 01:38:15.865164 24855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:15 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412295, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:15.868992 24855 init.cc:377] Logged in from keytab as oryx/127.17.132.2@KRBTEST.COM (short username oryx)
I20260811 01:38:15.871110 24855 webserver.cc:460] Webserver started at http://127.17.132.2:45365/ using document root <none> and password file <none>
I20260811 01:38:15.872123 24855 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:15.872279 24855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:15.872684 24855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:15.877918 24855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "44b89f62d0e544419dde3fbf63318a47"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "33b84fbf022379fc6b8fac49f91005fd"
server_key_iv: "2b30e19f254b05a48a3214de3b0fe141"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.879297 24855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "44b89f62d0e544419dde3fbf63318a47"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "33b84fbf022379fc6b8fac49f91005fd"
server_key_iv: "2b30e19f254b05a48a3214de3b0fe141"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.887974 24855 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260811 01:38:15.892840 24871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.894426 24855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:38:15.894634 24855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "44b89f62d0e544419dde3fbf63318a47"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "33b84fbf022379fc6b8fac49f91005fd"
server_key_iv: "2b30e19f254b05a48a3214de3b0fe141"
server_key_version: "encryptionkey@0"
I20260811 01:38:15.894896 24855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:15.938755 24855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:15.943534 24855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:15.943939 24855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:15.945165 24855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:15.946930 24855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:15.947038 24855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.947199 24855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:15.947275 24855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:15.983891 24855 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:46333
I20260811 01:38:15.983990 24994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:46333 every 8 connection(s)
I20260811 01:38:15.985451 24855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:15.992476 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 24855
I20260811 01:38:15.992712 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:15.993152 17936 external_mini_cluster.cc:1428] Setting key 19926595280953d641a58663d33a2fd7
Aug 11 01:38:15 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412295, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:16.014490 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:15.988921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:49271)
0811 01:38:15.989653 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:15.989718 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:15.991523 (+ 1805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:15.992236 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:15.992244 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:15.992929 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:15.993622 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:15.993642 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.994850 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.994854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:15.996183 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:15.996202 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.997121 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.997129 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:15.997391 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:15.998236 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:15.998262 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:16.001183 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:16.008516 (+ 7333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:16.008551 (+ 35us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:16.008577 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:16.009395 (+ 818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:16.010038 (+ 643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:16.010044 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:16.010048 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:16.010394 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:16.011357 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:16.011367 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:16.011904 (+ 537us) client_negotiation.cc:769] Sending connection context
0811 01:38:16.012268 (+ 364us) client_negotiation.cc:240] Negotiation successful
0811 01:38:16.012962 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":300,"threads_started":1}
I20260811 01:38:16.014745 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:15.988278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:49271 (local address 127.17.132.62:40975)
0811 01:38:15.988791 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:15.988798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:15.989900 (+ 1102us) server_negotiation.cc:407] Connection header received
0811 01:38:15.991822 (+ 1922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:15.991827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:15.991903 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:15.992048 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:15.993875 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.994658 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.996385 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:15.996836 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:15.996994 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:16.001544 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:16.001555 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:16.001561 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:16.001615 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:16.008216 (+ 6601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:16.009584 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:16.009593 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:16.009597 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:16.009858 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:16.010576 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:16.010581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:16.010584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:16.011057 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:16.011242 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:16.014021 (+ 2779us) server_negotiation.cc:299] Negotiation successful
0811 01:38:16.014313 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":246,"threads_started":1}
I20260811 01:38:16.016211 24995 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:16.016649 24995 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:16.017652 24995 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:16.019595 24643 ts_manager.cc:194] Registered new tserver with Master: 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:16.020993 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:49271
WARNING: no policy specified for oryx/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
I20260811 01:38:16.062461 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:16.426117 24849 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
W20260811 01:38:16.445554 25001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:16.446048 25001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:16.446209 25001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:16.454674 25001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:16.454818 25001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:16.454952 25001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:16.465692 25001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:16.467199 25001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:16.468634 25001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:16.484022 25007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:16.484148 25009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:16.484292 25006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:16.485114 25001 server_base.cc:1034] running on GCE node
I20260811 01:38:16.486016 25001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:16.487258 25001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:16.488539 25001 hybrid_clock.cc:648] HybridClock initialized: now 1786412296488461 us; error 66 us; skew 500 ppm
I20260811 01:38:16.488974 25001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:16 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412296, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:16.492980 25001 init.cc:377] Logged in from keytab as oryx/127.17.132.3@KRBTEST.COM (short username oryx)
I20260811 01:38:16.495028 25001 webserver.cc:460] Webserver started at http://127.17.132.3:40601/ using document root <none> and password file <none>
I20260811 01:38:16.495852 25001 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:16.496021 25001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:16.496379 25001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:16.500037 25001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b"
format_stamp: "Formatted at 2026-08-11 01:38:16 on dist-test-slave-0kls"
server_key: "2ca17dbb537477dd1ce2743cad60eead"
server_key_iv: "b739f850574abc265c491a9925f16781"
server_key_version: "encryptionkey@0"
I20260811 01:38:16.501020 25001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b"
format_stamp: "Formatted at 2026-08-11 01:38:16 on dist-test-slave-0kls"
server_key: "2ca17dbb537477dd1ce2743cad60eead"
server_key_iv: "b739f850574abc265c491a9925f16781"
server_key_version: "encryptionkey@0"
I20260811 01:38:16.507447 25001 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260811 01:38:16.511794 25016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:16.513649 25001 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 01:38:16.513922 25001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b"
format_stamp: "Formatted at 2026-08-11 01:38:16 on dist-test-slave-0kls"
server_key: "2ca17dbb537477dd1ce2743cad60eead"
server_key_iv: "b739f850574abc265c491a9925f16781"
server_key_version: "encryptionkey@0"
I20260811 01:38:16.514179 25001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:16.542620 25001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:16.548017 25001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:16.548378 25001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:16.549540 25001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:16.551211 25001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:16.551328 25001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:16.551494 25001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:16.551576 25001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:16.590761 25001 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:37717
I20260811 01:38:16.590812 25139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:37717 every 8 connection(s)
I20260811 01:38:16.592319 25001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:16.597035 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25001
I20260811 01:38:16.597312 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:16.597846 17936 external_mini_cluster.cc:1428] Setting key 068b5791795e5df736c85e16874ac487
Aug 11 01:38:16 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412296, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:16.615934 25142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:16.595300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:34143 (local address 127.17.132.62:40975)
0811 01:38:16.595800 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:16.595804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:16.596738 (+ 934us) server_negotiation.cc:407] Connection header received
0811 01:38:16.599100 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:16.599106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:16.599224 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:16.599347 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:16.601664 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:16.602602 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:16.604432 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:16.604860 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:16.604973 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:16.609198 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:16.609204 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:16.609207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:16.609251 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:16.612071 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:16.613081 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:16.613086 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:16.613088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:16.613239 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:16.613915 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:16.613919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:16.613921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:16.614329 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:16.614498 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:16.615291 (+ 793us) server_negotiation.cc:299] Negotiation successful
0811 01:38:16.615536 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":270,"threads_started":1}
I20260811 01:38:16.616967 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:16.595735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:34143)
0811 01:38:16.596521 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:16.596594 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:16.598791 (+ 2197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:16.599727 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:16.599743 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:16.600588 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:16.601445 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:16.601483 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:16.602805 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:16.602809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:16.604278 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:16.604292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:16.605101 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:16.605107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:16.605343 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:16.606265 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:16.606292 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:16.608918 (+ 2626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:16.612396 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:16.612405 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:16.612420 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:16.612955 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:16.613434 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:16.613440 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:16.613445 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:16.613784 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:16.614468 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:16.614477 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:16.614881 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 01:38:16.615171 (+ 290us) client_negotiation.cc:240] Negotiation successful
0811 01:38:16.615789 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":317,"threads_started":1}
I20260811 01:38:16.618441 25140 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:16.618801 25140 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:16.619616 25140 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:16.621203 24643 ts_manager.cc:194] Registered new tserver with Master: e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:16.622090 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:34143
I20260811 01:38:16.626909 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.132.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.61.keytab.
Entry for principal oryx/127.17.132.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.61.keytab.
I20260811 01:38:16.691412 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:45945
--webserver_interface=127.17.132.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.61.keytab
--principal=oryx/127.17.132.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40975,127.17.132.61:45945
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:17.024937 24995 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
W20260811 01:38:17.065744 25146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:17.066231 25146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:17.066396 25146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:17.074185 25146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:17.074370 25146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:17.074489 25146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:17.074589 25146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:17.074678 25146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:17.085448 25146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40975,127.17.132.61:45945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.61.keytab
--principal=oryx/127.17.132.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:45945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.132.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
W20260811 01:38:17.085934 25146 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.132.62:40975,127.17.132.61:45945'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 01:38:17.087116 25146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:17.088654 25146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:17.101991 25151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.101900 25154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.101966 25152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:17.102947 25146 server_base.cc:1034] running on GCE node
I20260811 01:38:17.103951 25146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:17.105556 25146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:17.106844 25146 hybrid_clock.cc:648] HybridClock initialized: now 1786412297106756 us; error 63 us; skew 500 ppm
I20260811 01:38:17.107255 25146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:17.110718 25146 init.cc:377] Logged in from keytab as oryx/127.17.132.61@KRBTEST.COM (short username oryx)
I20260811 01:38:17.112406 25146 webserver.cc:460] Webserver started at http://127.17.132.61:37523/ using document root <none> and password file <none>
I20260811 01:38:17.113335 25146 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:17.113482 25146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:17.113910 25146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:17.117206 25146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/instance:
uuid: "db6255f5279e423782f765b655f901ab"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "5639429ad6c72a1294d1512f81e5f920"
server_key_iv: "b1657d073f6e779e5f0330085736c689"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.118139 25146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal/instance:
uuid: "db6255f5279e423782f765b655f901ab"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "5639429ad6c72a1294d1512f81e5f920"
server_key_iv: "b1657d073f6e779e5f0330085736c689"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.124046 25146 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:38:17.127774 25161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:17.129231 25146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:38:17.129438 25146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "db6255f5279e423782f765b655f901ab"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "5639429ad6c72a1294d1512f81e5f920"
server_key_iv: "b1657d073f6e779e5f0330085736c689"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.129705 25146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:17.142439 25146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:17.146576 25146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:17.146924 25146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:17.167003 25146 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.61:45945
I20260811 01:38:17.167012 25217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.61:45945 every 8 connection(s)
I20260811 01:38:17.168622 25146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
I20260811 01:38:17.170326 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25146
I20260811 01:38:17.174013 25218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:17.181705 25218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.61@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:17.196923 25221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.172884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.17.132.61:45945)
0811 01:38:17.173754 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.173768 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.173900 (+ 132us) server_negotiation.cc:407] Connection header received
0811 01:38:17.175680 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.175705 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.176118 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.176577 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.178320 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.179742 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.181046 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.181777 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.182078 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.187567 (+ 5489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.187575 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.187586 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.187642 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.191501 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.192559 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.192567 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.192575 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.192778 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.193265 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.193272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.193276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.193996 (+ 720us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.194397 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.194875 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.195404 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":407,"threads_started":1}
I20260811 01:38:17.202965 25222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.184678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46888 (local address 127.17.132.62:40975)
0811 01:38:17.185268 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.185275 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.185876 (+ 601us) server_negotiation.cc:407] Connection header received
0811 01:38:17.186193 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.186197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.186268 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.186426 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.187982 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.189476 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.191257 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.191898 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.192000 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.195864 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.195874 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.195879 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.195929 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.199393 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.200669 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.200676 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.200679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.200863 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.201395 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.201399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.201402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.201840 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.202005 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.202503 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.202706 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":282,"threads_started":1}
I20260811 01:38:17.202997 25223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.184769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46888)
0811 01:38:17.185699 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.185745 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.185985 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.186526 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.186534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.187444 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.187813 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.187825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.189718 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.189731 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.191055 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.191089 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.192129 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.192136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.192356 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.193078 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.193097 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.195622 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.199659 (+ 4037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.199670 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.199678 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.200480 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.201019 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.201023 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.201026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.201228 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.202018 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.202025 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.202195 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.202365 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.202670 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":450,"threads_started":1}
I20260811 01:38:17.205022 25218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.61@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
I20260811 01:38:17.218699 25223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.205770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36788)
0811 01:38:17.206048 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.206099 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.206234 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.206582 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.206586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.206973 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.207116 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.207125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.208134 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.208140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.209045 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.209056 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.209830 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.209836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.210023 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.210660 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.210678 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.212885 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.216048 (+ 3163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.216053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.216057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.216454 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.216885 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.216890 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.216893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.217035 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.217572 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.217577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.217743 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.217944 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.218288 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 01:38:17.218863 25221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.206016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36788 (local address 127.17.132.61:45945)
0811 01:38:17.206211 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.206217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.206236 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:38:17.206378 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.206390 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.206445 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.206548 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.207250 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.207982 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.209198 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.209640 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.209779 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.213088 (+ 3309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.213094 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.213097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.213127 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.215884 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.216582 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.216590 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.216593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.216747 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.217147 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.217154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.217157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.217452 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.217612 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.218023 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.218476 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":169,"server-negotiator.queue_time_us":92}
I20260811 01:38:17.223922 25218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Bootstrap starting.
I20260811 01:38:17.227397 25218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:17.228516 25218 log.cc:824] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:17.232055 25218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: No bootstrap required, opened a new log
I20260811 01:38:17.243256 25218 raft_consensus.cc:348] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } }
I20260811 01:38:17.243629 25218 raft_consensus.cc:374] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:17.243714 25218 raft_consensus.cc:729] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db6255f5279e423782f765b655f901ab, State: Initialized, Role: FOLLOWER
I20260811 01:38:17.244264 25218 consensus_queue.cc:260] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } }
I20260811 01:38:17.245126 25225 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } }
I20260811 01:38:17.245514 25225 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:38:17.246307 25218 sys_catalog.cc:564] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:38:17.255982 25237 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:38:17.256135 25237 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:38:17.258960 25146 master_runner.cc:428] Detected that this master db6255f5279e423782f765b655f901ab is joining an existing cluster
I20260811 01:38:17.259084 25146 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.132.61:45945
I20260811 01:38:17.284163 25222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.264255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46904 (local address 127.17.132.62:40975)
0811 01:38:17.264522 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.264530 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.266523 (+ 1993us) server_negotiation.cc:407] Connection header received
0811 01:38:17.267454 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.267461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.267562 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.267647 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.269461 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.270673 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.272893 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.273577 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.273681 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.276756 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.276762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.276766 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.276808 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.280634 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.281512 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.281518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.281521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.281686 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.282230 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.282235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.282239 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.282627 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.282800 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.283503 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.283780 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
WARNING: no policy specified for oryx/127.17.132.60@KRBTEST.COM; defaulting to no policy
I20260811 01:38:17.285646 25243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.264185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46904)
0811 01:38:17.266395 (+ 2210us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.266419 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.266663 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.267920 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.267924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.268805 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.269251 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.269266 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.270892 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.270899 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.272685 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.272710 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.274062 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.274069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.274281 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.275141 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.275170 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.276488 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.280828 (+ 4340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.280834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.280839 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.281346 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.281890 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.281895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.281899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.282091 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.282911 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.282916 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.283157 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.284676 (+ 1519us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.285076 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2004,"mutex_wait_us":77,"thread_start_us":1803,"threads_started":1}
I20260811 01:38:17.285708 25221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.266648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36796 (local address 127.17.132.61:45945)
0811 01:38:17.266933 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.266948 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.267618 (+ 670us) server_negotiation.cc:407] Connection header received
0811 01:38:17.267927 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.267936 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.268015 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.268086 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.269872 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.271055 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.273295 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.274169 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.274414 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.277778 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.277839 (+ 61us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.277847 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.277892 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.282219 (+ 4327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.283123 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.283129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.283133 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.283314 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.283786 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.283791 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.283795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.284185 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.284349 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.285066 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.285330 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":67}
I20260811 01:38:17.286720 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.266835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36796)
0811 01:38:17.267525 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.267552 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.267714 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.268326 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.268332 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.269294 (+ 962us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.269683 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.269702 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.271283 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.271294 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.273143 (+ 1849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.273161 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.275102 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.275114 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.275359 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.276014 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.276040 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.277304 (+ 1264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.282394 (+ 5090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.282398 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.282402 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.282975 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.283479 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.283484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.283487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.283670 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.284449 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.284455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.284780 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.285761 (+ 981us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.286084 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":34,"thread_start_us":325,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.60@KRBTEST.COM" created.
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.62@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
I20260811 01:38:17.311905 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.293349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36808)
0811 01:38:17.294490 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.294549 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.294846 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.295412 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.295422 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.296520 (+ 1098us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.296941 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.296958 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.298479 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.298483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.299716 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.299737 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.300679 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.300685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.300923 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.301720 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.301742 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.304345 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.308035 (+ 3690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.308055 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.308065 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.308593 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.309164 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.309171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.309176 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.309409 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.310435 (+ 1026us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.310445 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.310720 (+ 275us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.310982 (+ 262us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.311428 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":724,"threads_started":1}
I20260811 01:38:17.311933 25221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.293491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36808 (local address 127.17.132.61:45945)
0811 01:38:17.293741 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.293747 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.294654 (+ 907us) server_negotiation.cc:407] Connection header received
0811 01:38:17.295097 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.295102 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.295207 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.295349 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.297204 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.298247 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.300003 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.300473 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.300653 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.304623 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.304629 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.304633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.304671 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.307837 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.308761 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.308770 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.308775 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.308981 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.309593 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.309602 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.309607 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.310210 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.310434 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.311129 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.311448 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:38:17.314911 24643 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.132.61:45945: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "db6255f5279e423782f765b655f901ab"
member_type: NON_VOTER
last_known_addr {
host: "127.17.132.61"
port: 45945
}
attrs {
promote: true
}
}
dest_uuid: "73c62fe0c43e4b1c8893cd499928a2a0"
cas_config_opid_index: -1
I20260811 01:38:17.316323 24643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } }
I20260811 01:38:17.332324 25189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:17.332391 25253 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER db6255f5279e423782f765b655f901ab (127.17.132.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:17.336880 25253 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.132.61:45945
I20260811 01:38:17.337110 25189 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 01:38:17.337419 25225 raft_consensus.cc:482] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:17.337600 25253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:17.337870 25253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:17.337749 25225 raft_consensus.cc:504] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } }
I20260811 01:38:17.338972 25146 master.cc:537] Master@127.17.132.61:45945 shutting down...
I20260811 01:38:17.339998 25253 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.60.keytab.
Entry for principal oryx/127.17.132.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.60.keytab.
I20260811 01:38:17.341363 24654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db6255f5279e423782f765b655f901ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" is_pre_election: true
I20260811 01:38:17.342254 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:45925
--webserver_interface=127.17.132.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.60.keytab
--principal=oryx/127.17.132.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:17.342720 25225 leader_election.cc:288] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975)
I20260811 01:38:17.343053 25165 leader_election.cc:302] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: db6255f5279e423782f765b655f901ab; no voters: 73c62fe0c43e4b1c8893cd499928a2a0
I20260811 01:38:17.343966 25225 raft_consensus.cc:2726] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 01:38:17.344944 24630 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 01:38:17.350257 24630 consensus_peers.cc:487] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 -> Peer db6255f5279e423782f765b655f901ab (127.17.132.61:45945): Couldn't send request to peer db6255f5279e423782f765b655f901ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:38:17.357578 25146 raft_consensus.cc:2229] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:17.358111 25146 raft_consensus.cc:2258] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:17.358325 25146 tablet_replica.cc:330] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: stopping tablet replica
I20260811 01:38:17.366518 25146 master.cc:552] Master@127.17.132.61:45945 shutdown complete.
I20260811 01:38:17.366686 25146 master_runner.cc:305] Clearing existing system tablet
I20260811 01:38:17.367331 25146 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:17.367465 25146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:17.371556 25146 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 01:38:17.373842 25261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:17.374254 25146 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:17.374647 25146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260811 01:38:17.374779 25146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "db6255f5279e423782f765b655f901ab"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "5639429ad6c72a1294d1512f81e5f920"
server_key_iv: "b1657d073f6e779e5f0330085736c689"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.381494 25146 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:17.390066 25146 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:38:17.390305 25146 log.cc:1196] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 01:38:17.390813 25146 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Deleting consensus metadata
I20260811 01:38:17.391177 25146 master_runner.cc:315] Copying system tablet from 127.17.132.62:40975
I20260811 01:38:17.394146 25146 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: tablet copy: Beginning tablet copy session from remote peer at address 127.17.132.62:40975
I20260811 01:38:17.414953 25222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.395128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.17.132.62:40975)
0811 01:38:17.395331 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.395337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.398494 (+ 3157us) server_negotiation.cc:407] Connection header received
0811 01:38:17.398789 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.398796 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.398889 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.399030 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.400436 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.401607 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.403669 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.404349 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.404490 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.407380 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.407388 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.407394 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.407440 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.411223 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.412229 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.412238 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.412242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.412432 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.412989 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.412997 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.413003 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.413468 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.413644 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.414264 (+ 620us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.414543 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:38:17.414983 25267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.395014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46906)
0811 01:38:17.398324 (+ 3310us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.398349 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.398548 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.399176 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.399182 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.399846 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.400242 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.400258 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.401843 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.401849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.403476 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.403499 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.404549 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.404555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.404780 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.405749 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.405774 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.407085 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.411402 (+ 4317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.411408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.411413 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.412028 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.412590 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.412596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.412600 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.412824 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.413630 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.413636 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.413894 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.414074 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.414460 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3146,"thread_start_us":2964,"threads_started":1}
I20260811 01:38:17.416265 24664 tablet_copy_service.cc:140] P 73c62fe0c43e4b1c8893cd499928a2a0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer db6255f5279e423782f765b655f901ab ({username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:46906)
I20260811 01:38:17.416572 24664 tablet_copy_service.cc:161] P 73c62fe0c43e4b1c8893cd499928a2a0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer db6255f5279e423782f765b655f901ab at {username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:46906: session id = db6255f5279e423782f765b655f901ab-00000000000000000000000000000000
I20260811 01:38:17.421407 24664 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:38:17.424099 25146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:38:17.432206 25146 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: tablet copy: Starting download of 0 data blocks...
I20260811 01:38:17.432593 25146 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: tablet copy: Starting download of 1 WAL segments...
I20260811 01:38:17.435802 25146 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:38:17.441352 24664 tablet_copy_service.cc:342] P 73c62fe0c43e4b1c8893cd499928a2a0: Request end of tablet copy session db6255f5279e423782f765b655f901ab-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:46906
I20260811 01:38:17.441619 24664 tablet_copy_service.cc:433] P 73c62fe0c43e4b1c8893cd499928a2a0: ending tablet copy session db6255f5279e423782f765b655f901ab-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer db6255f5279e423782f765b655f901ab
I20260811 01:38:17.457935 25146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:17.461182 25268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.463196 25269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.479692 25271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:17.480214 25146 server_base.cc:1034] running on GCE node
I20260811 01:38:17.480623 25146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:17.481410 25146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:17.482709 25146 hybrid_clock.cc:648] HybridClock initialized: now 1786412297482597 us; error 63 us; skew 500 ppm
I20260811 01:38:17.482986 25146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:17.485437 25146 init.cc:377] Logged in from keytab as oryx/127.17.132.61@KRBTEST.COM (short username oryx)
I20260811 01:38:17.491215 25146 webserver.cc:460] Webserver started at http://127.17.132.61:39239/ using document root <none> and password file <none>
I20260811 01:38:17.491679 25146 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:17.491786 25146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:17.495445 25146 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:38:17.498042 25278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:17.498659 25146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 01:38:17.498879 25146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "db6255f5279e423782f765b655f901ab"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "5639429ad6c72a1294d1512f81e5f920"
server_key_iv: "b1657d073f6e779e5f0330085736c689"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.499248 25146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:17.524461 25146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:17.528855 25146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:17.560714 25146 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.61:45945
I20260811 01:38:17.560768 25335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.61:45945 every 8 connection(s)
I20260811 01:38:17.561896 25146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
I20260811 01:38:17.567420 25336 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:38:17.572022 25336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Bootstrap starting.
I20260811 01:38:17.593286 25336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:38:17.594095 25336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Bootstrap complete.
I20260811 01:38:17.595403 25336 raft_consensus.cc:348] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } }
I20260811 01:38:17.595815 25336 raft_consensus.cc:729] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: db6255f5279e423782f765b655f901ab, State: Initialized, Role: LEARNER
I20260811 01:38:17.596156 25336 consensus_queue.cc:260] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } }
I20260811 01:38:17.598269 25340 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:17.598596 25336 sys_catalog.cc:564] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:17.598714 25340 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: LEARNER
I20260811 01:38:17.605957 25352 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:38:17.624837 25140 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
W20260811 01:38:17.806077 25258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:17.806406 25258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:17.806576 25258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:17.814625 25258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:17.814752 25258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:17.814841 25258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:17.814946 25258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:17.815026 25258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:17.825866 25258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.60.keytab
--principal=oryx/127.17.132.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:45925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.132.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:17.827363 25258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:17.828773 25258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:17.841702 25358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.841802 25362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:17.841722 25359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:17.842893 25258 server_base.cc:1034] running on GCE node
I20260811 01:38:17.843807 25258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:17.845325 25258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:17.846558 25258 hybrid_clock.cc:648] HybridClock initialized: now 1786412297846506 us; error 32 us; skew 500 ppm
I20260811 01:38:17.846946 25258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:17.850391 25258 init.cc:377] Logged in from keytab as oryx/127.17.132.60@KRBTEST.COM (short username oryx)
I20260811 01:38:17.851933 25258 webserver.cc:460] Webserver started at http://127.17.132.60:38401/ using document root <none> and password file <none>
I20260811 01:38:17.852633 25258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:17.852746 25258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:17.853013 25258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:17.856479 25258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/instance:
uuid: "c022054a18ff4792a2491ac8ab6c6551"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "eab2325b3ce77b3c79af34352917d786"
server_key_iv: "7ce0a903caf28954ef2c098415d19587"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.857229 25258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal/instance:
uuid: "c022054a18ff4792a2491ac8ab6c6551"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "eab2325b3ce77b3c79af34352917d786"
server_key_iv: "7ce0a903caf28954ef2c098415d19587"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.863245 25258 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 01:38:17.867231 25370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:17.868921 25258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:17.869139 25258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "c022054a18ff4792a2491ac8ab6c6551"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "eab2325b3ce77b3c79af34352917d786"
server_key_iv: "7ce0a903caf28954ef2c098415d19587"
server_key_version: "encryptionkey@0"
I20260811 01:38:17.869378 25258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:17.893347 25258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:17.900157 25258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:17.900509 25258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:17.914535 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.895506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36822)
0811 01:38:17.896065 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.896086 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.896219 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.897110 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.897118 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.897724 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.898080 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.898098 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.900174 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.900181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.901945 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.901962 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.903061 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.903067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.903273 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.904099 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.904124 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.905213 (+ 1089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.910465 (+ 5252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.910474 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.910481 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.911232 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.911798 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.911806 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.911811 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.912064 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.913077 (+ 1013us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.913082 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.913342 (+ 260us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.913515 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.913981 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":292,"threads_started":1}
I20260811 01:38:17.914789 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.895691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.17.132.61:45945)
0811 01:38:17.896715 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.896721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.896742 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:38:17.896817 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.896823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.896912 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.897021 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.898298 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.899951 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.902180 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.902871 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.903704 (+ 833us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.905460 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.905469 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.905477 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.905523 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.910198 (+ 4675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.911456 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.911463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.911466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.911648 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.912313 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.912318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.912321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.912888 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.913898 (+ 1010us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.914049 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.914320 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":858,"thread_start_us":736,"threads_started":1}
I20260811 01:38:17.916399 25309 raft_consensus.cc:1203] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 01:38:17.917179 25340 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73c62fe0c43e4b1c8893cd499928a2a0. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:17.917495 25340 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: LEARNER
I20260811 01:38:17.926168 25258 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.60:45925
I20260811 01:38:17.926210 25427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.60:45925 every 8 connection(s)
I20260811 01:38:17.927644 25258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
I20260811 01:38:17.929528 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25258
I20260811 01:38:17.932729 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:17.941972 25428 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.60@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:17.957098 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.931963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57260 (local address 127.17.132.60:45925)
0811 01:38:17.933012 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.933028 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.933311 (+ 283us) server_negotiation.cc:407] Connection header received
0811 01:38:17.935269 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.935291 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.935739 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.936083 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.938100 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.939787 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.941598 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.942550 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.942712 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.948416 (+ 5704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.948427 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.948442 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.948513 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.952397 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.953298 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.953308 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.953314 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.953501 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.953995 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.953999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.954001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.954741 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.955085 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.955536 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.955938 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":447,"threads_started":1}
I20260811 01:38:17.962330 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.945185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46912 (local address 127.17.132.62:40975)
0811 01:38:17.946708 (+ 1523us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.946714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.946733 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:38:17.946796 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.946801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.946890 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.947020 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.948388 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.949641 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.951210 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.951904 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.952056 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.955865 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.955870 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.955873 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.955906 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.959224 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.960289 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.960293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.960295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.960451 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.960810 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.960813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.960815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.961143 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.961256 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.961758 (+ 502us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.962022 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1389,"thread_start_us":1222,"threads_started":1}
I20260811 01:38:17.962603 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.945013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46912)
0811 01:38:17.945976 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.946030 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.946197 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.947096 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.947101 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.947891 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.948229 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.948238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.949871 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.949875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.951050 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.951063 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.952101 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.952106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.952239 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.952832 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.952864 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.955679 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.959382 (+ 3703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.959391 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.959397 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.959908 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.960567 (+ 659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.960570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.960572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.960708 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.961287 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.961293 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.961448 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.961668 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.962041 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":513,"threads_started":1}
I20260811 01:38:17.963990 25428 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.60@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
I20260811 01:38:17.976246 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.964640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36824)
0811 01:38:17.964850 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.964870 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.964975 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.965341 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.965344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.965651 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.965855 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.965865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.966784 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.966788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.967681 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.967694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.968342 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.968346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.968488 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.968993 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.969010 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.971104 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.974047 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.974051 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.974053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.974480 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.974835 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.974839 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.974843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.975019 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.975522 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.975525 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.975663 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.975791 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.976002 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 01:38:17.976356 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.964877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36824 (local address 127.17.132.61:45945)
0811 01:38:17.965062 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.965067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.965083 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:38:17.965149 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.965153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.965224 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.965304 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.965978 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.966668 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.967808 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.968197 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.968347 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.971277 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.971282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.971285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.971316 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.973927 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.974579 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.974583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.974586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.974725 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.975131 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.975134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.975136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.975419 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.975534 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.975879 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.976049 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:38:17.977339 25428 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:38:17 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412297, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.60@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
I20260811 01:38:17.990470 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.978149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.0.0.1:57274)
0811 01:38:17.978318 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:17.978333 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:17.978446 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:17.978755 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:17.978759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:17.979163 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:17.979297 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.979305 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.980286 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.980291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.981136 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:17.981147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.981881 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.981887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:17.982073 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.982593 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:17.982610 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:17.984869 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:17.987837 (+ 2968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.987845 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.987848 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.988237 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.988621 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:17.988627 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:17.988630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:17.988801 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:17.989353 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:17.989358 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:17.989510 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 01:38:17.989663 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 01:38:17.989998 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:38:17.990661 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:17.978352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57274 (local address 127.17.132.60:45925)
0811 01:38:17.978511 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:17.978517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:17.978534 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:38:17.978579 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:17.978582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:17.978631 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:17.978730 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:17.979430 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.980131 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.981279 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:17.981686 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:17.981839 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:17.985055 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:17.985060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:17.985063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:17.985091 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:17.987695 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.988359 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.988366 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.988369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.988511 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:17.988916 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:17.988923 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:17.988927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:17.989234 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:17.989393 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:17.989740 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 01:38:17.990158 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":49}
I20260811 01:38:17.996063 25428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Bootstrap starting.
I20260811 01:38:18.000027 25428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:18.001344 25428 log.cc:824] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:18.005828 25428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: No bootstrap required, opened a new log
I20260811 01:38:18.015969 25428 raft_consensus.cc:348] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } }
I20260811 01:38:18.016340 25428 raft_consensus.cc:374] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:18.016429 25428 raft_consensus.cc:729] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c022054a18ff4792a2491ac8ab6c6551, State: Initialized, Role: FOLLOWER
I20260811 01:38:18.017066 25428 consensus_queue.cc:260] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } }
I20260811 01:38:18.018136 25437 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } } }
I20260811 01:38:18.018503 25437 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:38:18.019470 25428 sys_catalog.cc:564] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:38:18.029899 25449 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:38:18.030066 25449 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:38:18.035818 25258 master_runner.cc:428] Detected that this master c022054a18ff4792a2491ac8ab6c6551 is joining an existing cluster
I20260811 01:38:18.035953 25258 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.132.60:45925
I20260811 01:38:18.062618 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.043741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46916 (local address 127.17.132.62:40975)
0811 01:38:18.043959 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.043967 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.045066 (+ 1099us) server_negotiation.cc:407] Connection header received
0811 01:38:18.045376 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.045382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.045482 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.045559 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.047328 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.048694 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.050873 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.051590 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.051702 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.054925 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.054933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.054938 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.054981 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.058865 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.059839 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.059847 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.059852 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.060025 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.060564 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.060568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.060571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.060869 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.061045 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.061959 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.062258 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:38:18.063841 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.044067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46916)
0811 01:38:18.044958 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.044979 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.045186 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.045830 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.045835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.046691 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.047131 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.047144 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.048935 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.048941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.050690 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.050706 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.052157 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.052166 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.052427 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.053271 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.053296 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.054681 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.059040 (+ 4359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.059048 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.059053 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.059649 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.060181 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.060186 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.060204 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.060430 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.061006 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.061010 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.061502 (+ 492us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.062830 (+ 1328us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.063187 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":536,"threads_started":1}
I20260811 01:38:18.064735 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24709
I20260811 01:38:18.073536 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.044080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57280 (local address 127.17.132.60:45925)
0811 01:38:18.044390 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.044400 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.053178 (+ 8778us) server_negotiation.cc:407] Connection header received
0811 01:38:18.053254 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.053262 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.053358 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.053477 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.055536 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.057148 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.059233 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.060031 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.060172 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.063096 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.063105 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.063113 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.063157 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.070289 (+ 7132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.071132 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.071137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.071140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.071348 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.071743 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.071750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.071753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.072141 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.072317 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.072878 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.073124 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56,"spinlock_wait_cycles":41856}
I20260811 01:38:18.074663 25459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.044573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.0.0.1:57280)
0811 01:38:18.052695 (+ 8122us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.052716 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.052887 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.053709 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.053716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.054857 (+ 1141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.055333 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.055351 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.057353 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.057357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.059057 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.059074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.060527 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.060535 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.060678 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.061473 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.061498 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.062909 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.070442 (+ 7533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.070448 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.070452 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.070984 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.071478 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.071482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.071485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.071633 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.072394 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.072399 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.072593 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.073727 (+ 1134us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.074075 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7971,"thread_start_us":12264,"threads_started":1}
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.1@KRBTEST.COM
I20260811 01:38:18.080293 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.045339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36830 (local address 127.17.132.61:45945)
0811 01:38:18.045573 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.045582 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.058815 (+ 13233us) server_negotiation.cc:407] Connection header received
0811 01:38:18.059108 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.059118 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.059220 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.059298 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.061974 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.063003 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.065764 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.066475 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.066583 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.070482 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.070491 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.070496 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.070543 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.074288 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.075933 (+ 1645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.075941 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.075944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.076175 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.078243 (+ 2068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.078252 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.078255 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.078727 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.078917 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.079580 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.079870 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:38:18.080343 25458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.045760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:36830)
0811 01:38:18.058674 (+ 12914us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.058705 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.058939 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.059502 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.059508 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.060272 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.061744 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.061762 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.063572 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.063577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.065563 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.065582 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.067813 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.067820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.068006 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.068662 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.068721 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.070228 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.075202 (+ 4974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.075207 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.075210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.075775 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.076355 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.076362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.077894 (+ 1532us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.078070 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.078990 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.078995 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.079200 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.079398 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.079800 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12749,"thread_start_us":6557,"threads_started":1}
I20260811 01:38:18.088436 25460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.067045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.17.132.1:32777)
0811 01:38:18.067773 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.067784 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.067813 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:38:18.067890 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.067899 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.068206 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.070249 (+ 2043us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.070527 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.072220 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.074533 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.075656 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.076467 (+ 811us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.081954 (+ 5487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.081971 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.081987 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.082028 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.085161 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.086014 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.086026 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.086028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.086184 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.086632 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.086638 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.086640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.087009 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.087362 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.087720 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.088015 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":363,"threads_started":1}
I20260811 01:38:18.089870 24844 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.62@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
I20260811 01:38:18.117688 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.104079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57282 (local address 127.17.132.60:45925)
0811 01:38:18.104284 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.104292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.104519 (+ 227us) server_negotiation.cc:407] Connection header received
0811 01:38:18.104634 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.104638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.104765 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.104880 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.105703 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.106551 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.107778 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.108241 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.108393 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.111788 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.111793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.111796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.111832 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.114913 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.115667 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.115672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.115678 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.115815 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.116223 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.116228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.116231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.116533 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.116697 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.117092 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.117330 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 01:38:18.117686 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.103912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.0.0.1:57282)
0811 01:38:18.104252 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.104275 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.104418 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.104923 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.104930 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.105364 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.105517 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.105527 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.106704 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.106710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.107608 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.107621 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.108406 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.108412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.108591 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.109254 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.109273 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.111557 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.115081 (+ 3524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.115087 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.115091 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.115528 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.115940 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.115945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.115949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.116106 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.116673 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.116678 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.116844 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.116993 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.117306 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260811 01:38:18.119665 24643 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.132.60:45925: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551"
member_type: NON_VOTER
last_known_addr {
host: "127.17.132.60"
port: 45925
}
attrs {
promote: true
}
}
dest_uuid: "73c62fe0c43e4b1c8893cd499928a2a0"
cas_config_opid_index: 5
I20260811 01:38:18.120939 24643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
I20260811 01:38:18.122751 25375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.136951 25401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:18.141352 25401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:38:18.146700 25464 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:18.147666 25309 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:38:18.148610 25375 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.132.60:45925
I20260811 01:38:18.148666 25464 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 01:38:18.149639 25258 master.cc:537] Master@127.17.132.60:45925 shutting down...
W20260811 01:38:18.153396 25379 tablet.cc:2369] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:18.154032 25462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.168164 25309 raft_consensus.cc:2932] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.156235 25462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:18.176237 25340 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.176698 25340 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: LEARNER
I20260811 01:38:18.178205 25375 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: attempting to promote NON_VOTER db6255f5279e423782f765b655f901ab to VOTER
I20260811 01:38:18.179327 25375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
I20260811 01:38:18.190136 25309 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 LEARNER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 01:38:18.191115 25462 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 01:38:18.194365 25375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, db6255f5279e423782f765b655f901ab (127.17.132.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.200109 25375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.200479 25375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:18.201267 25464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.201551 25464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:18.202277 25308 raft_consensus.cc:2932] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, db6255f5279e423782f765b655f901ab (127.17.132.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.208439 25340 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.208783 25340 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:38:18.213919 24629 consensus_peers.cc:487] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 -> Peer c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60:45925): Couldn't send request to peer c022054a18ff4792a2491ac8ab6c6551. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:38:18.215854 25401 raft_consensus.cc:858] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
W20260811 01:38:18.216277 25401 raft_consensus.cc:1565] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
I20260811 01:38:18.231320 25401 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER db6255f5279e423782f765b655f901ab (127.17.132.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:18.235492 25473 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:18.236263 25437 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73c62fe0c43e4b1c8893cd499928a2a0. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:18.236912 25470 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: NON_VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: true } } }
I20260811 01:38:18.237401 25437 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:38:18.237439 25473 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:38:18.237660 25470 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:38:18.240156 25258 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 01:38:18.240715 25258 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 01:38:18.240926 25258 tablet_replica.cc:330] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: stopping tablet replica
I20260811 01:38:18.242615 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24709
I20260811 01:38:18.253489 25258 master.cc:552] Master@127.17.132.60:45925 shutdown complete.
I20260811 01:38:18.253590 25258 master_runner.cc:305] Clearing existing system tablet
I20260811 01:38:18.254027 25258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:18.254153 25258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:18.257602 25258 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 01:38:18.259460 25475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:18.259867 25258 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:18.260138 25258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 01:38:18.260252 25258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "c022054a18ff4792a2491ac8ab6c6551"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "eab2325b3ce77b3c79af34352917d786"
server_key_iv: "7ce0a903caf28954ef2c098415d19587"
server_key_version: "encryptionkey@0"
I20260811 01:38:18.265131 25258 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:18.267297 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:32777
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:40975
--webserver_port=46099
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:18.272596 25258 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:38:18.272797 25258 log.cc:1196] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 01:38:18.273375 25258 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Deleting consensus metadata
I20260811 01:38:18.273649 25258 master_runner.cc:315] Copying system tablet from 127.17.132.62:40975
I20260811 01:38:18.279129 25258 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: tablet copy: Beginning tablet copy session from remote peer at address 127.17.132.62:40975
I20260811 01:38:18.297588 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.280113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.17.132.62:40975)
0811 01:38:18.280371 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.280379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.280947 (+ 568us) server_negotiation.cc:407] Connection header received
0811 01:38:18.281144 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.281152 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.281290 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.281408 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.282639 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.283789 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.285898 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.286735 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.286896 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.289652 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.289662 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.289670 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.289724 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.294045 (+ 4321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.295001 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.295011 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.295017 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.295202 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.295687 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.295695 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.295698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.296196 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.296374 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.296879 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.297152 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260811 01:38:18.297611 25482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.280064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:46930)
0811 01:38:18.280800 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.280825 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.281001 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.281475 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.281481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.282125 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.282425 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.282440 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.284020 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.284024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.285656 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.285684 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.286952 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.286958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.287167 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.288125 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.288152 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.289386 (+ 1234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.294246 (+ 4860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.294252 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.294256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.294839 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.295347 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.295352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.295356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.295553 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.296336 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.296341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.296544 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.296719 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.297086 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":444,"threads_started":1}
I20260811 01:38:18.298739 24664 tablet_copy_service.cc:140] P 73c62fe0c43e4b1c8893cd499928a2a0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c022054a18ff4792a2491ac8ab6c6551 ({username='oryx', principal='oryx/127.17.132.60@KRBTEST.COM'} at 127.0.0.1:46930)
I20260811 01:38:18.298938 24664 tablet_copy_service.cc:161] P 73c62fe0c43e4b1c8893cd499928a2a0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c022054a18ff4792a2491ac8ab6c6551 at {username='oryx', principal='oryx/127.17.132.60@KRBTEST.COM'} at 127.0.0.1:46930: session id = c022054a18ff4792a2491ac8ab6c6551-00000000000000000000000000000000
I20260811 01:38:18.302747 24664 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:38:18.304812 25258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:38:18.312063 25258 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: tablet copy: Starting download of 0 data blocks...
I20260811 01:38:18.312397 25258 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: tablet copy: Starting download of 1 WAL segments...
I20260811 01:38:18.315241 25258 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:38:18.320178 24664 tablet_copy_service.cc:342] P 73c62fe0c43e4b1c8893cd499928a2a0: Request end of tablet copy session c022054a18ff4792a2491ac8ab6c6551-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.132.60@KRBTEST.COM'} at 127.0.0.1:46930
I20260811 01:38:18.320364 24664 tablet_copy_service.cc:433] P 73c62fe0c43e4b1c8893cd499928a2a0: ending tablet copy session c022054a18ff4792a2491ac8ab6c6551-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c022054a18ff4792a2491ac8ab6c6551
I20260811 01:38:18.332154 25258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:18.335098 25483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:18.339718 25484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:18.354132 25258 server_base.cc:1034] running on GCE node
W20260811 01:38:18.355647 25487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:18.356184 25258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:18.356928 25258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:18.358132 25258 hybrid_clock.cc:648] HybridClock initialized: now 1786412298358092 us; error 37 us; skew 500 ppm
I20260811 01:38:18.358412 25258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412298, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:18.360821 25258 init.cc:377] Logged in from keytab as oryx/127.17.132.60@KRBTEST.COM (short username oryx)
I20260811 01:38:18.366983 25258 webserver.cc:460] Webserver started at http://127.17.132.60:33679/ using document root <none> and password file <none>
I20260811 01:38:18.367424 25258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:18.367540 25258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:18.371002 25258 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:38:18.373242 25493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:18.373765 25258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 01:38:18.373929 25258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "c022054a18ff4792a2491ac8ab6c6551"
format_stamp: "Formatted at 2026-08-11 01:38:17 on dist-test-slave-0kls"
server_key: "eab2325b3ce77b3c79af34352917d786"
server_key_iv: "7ce0a903caf28954ef2c098415d19587"
server_key_version: "encryptionkey@0"
I20260811 01:38:18.374145 25258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:18.388717 25258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:18.393277 25258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:18.417907 25258 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.60:45925
I20260811 01:38:18.417968 25549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.60:45925 every 8 connection(s)
I20260811 01:38:18.419121 25258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
I20260811 01:38:18.424791 25550 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:38:18.429018 25550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Bootstrap starting.
I20260811 01:38:18.448076 25550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:38:18.449049 25550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: Bootstrap complete.
I20260811 01:38:18.450433 25550 raft_consensus.cc:348] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
I20260811 01:38:18.450894 25550 raft_consensus.cc:729] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c022054a18ff4792a2491ac8ab6c6551, State: Initialized, Role: LEARNER
I20260811 01:38:18.451237 25550 consensus_queue.cc:260] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } }
I20260811 01:38:18.452365 25553 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.452744 25550 sys_catalog.cc:564] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:18.452988 25553 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:38:18.463675 25564 catalog_manager.cc:1259] Loaded cluster ID: 66ecc8464f0b4f7f97d8345b89369eeb
I20260811 01:38:18.463815 25564 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: loading cluster ID for follower catalog manager: success
I20260811 01:38:18.467605 25564 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: acquiring CA information for follower catalog manager: success
I20260811 01:38:18.470494 25564 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:38:18.608289 25352 catalog_manager.cc:1259] Loaded cluster ID: 66ecc8464f0b4f7f97d8345b89369eeb
I20260811 01:38:18.608408 25352 catalog_manager.cc:1552] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: loading cluster ID for follower catalog manager: success
I20260811 01:38:18.611034 25352 catalog_manager.cc:1574] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: acquiring CA information for follower catalog manager: success
I20260811 01:38:18.612932 25352 catalog_manager.cc:1602] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 01:38:18.679629 25478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:18.679939 25478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:18.680138 25478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:18.688278 25478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:18.688426 25478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:18.688637 25478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:18.699229 25478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:32777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=46099
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:18.700775 25478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:18.702375 25478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:18.717387 25569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:18.717406 25572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:18.717355 25575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:18.718858 25478 server_base.cc:1034] running on GCE node
I20260811 01:38:18.719652 25478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:18.720957 25478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:18.722200 25478 hybrid_clock.cc:648] HybridClock initialized: now 1786412298722132 us; error 61 us; skew 500 ppm
I20260811 01:38:18.722582 25478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412298, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:18.726078 25478 init.cc:377] Logged in from keytab as oryx/127.17.132.1@KRBTEST.COM (short username oryx)
I20260811 01:38:18.727655 25478 webserver.cc:460] Webserver started at http://127.17.132.1:46099/ using document root <none> and password file <none>
I20260811 01:38:18.728367 25478 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:18.728490 25478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:18.734108 25478 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:18.736976 25582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:18.738499 25478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:18.738698 25478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "ec9198d9aee977ce4617c3b14e105e8f"
server_key_iv: "5fb9aebfd64a7f26c1953fcaaf9fbafb"
server_key_version: "encryptionkey@0"
I20260811 01:38:18.739851 25478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:18.764392 25589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.757484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.0.0.1:57292)
0811 01:38:18.758006 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.758063 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.758206 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.758611 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.758614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.758634 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:18.758881 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.758889 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.760644 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.760648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.762137 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.762152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.763743 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.763747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.763902 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.763954 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.764045 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.764162 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":232,"threads_started":1}
I20260811 01:38:18.764549 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.757639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57292 (local address 127.17.132.60:45925)
0811 01:38:18.758232 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.758238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.758280 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:38:18.758353 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.758359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.758444 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.758571 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:18.759017 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.760468 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.762291 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.763525 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.763677 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.763940 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.764085 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.764227 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":325,"threads_started":1}
I20260811 01:38:18.765514 25523 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 01:38:18.766026 25553 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73c62fe0c43e4b1c8893cd499928a2a0. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:18.766402 25553 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:38:18.777777 25478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:18.782755 25478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:18.783067 25478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:18.784173 25478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:18.785724 25478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:18.785876 25478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 01:38:18.786019 25478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:18.786125 25478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:18.825749 25478 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:32777
I20260811 01:38:18.825866 25706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:32777 every 8 connection(s)
I20260811 01:38:18.827265 25478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:18.830080 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25478
I20260811 01:38:18.830466 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24855
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412298, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
I20260811 01:38:18.860999 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.831337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:56291 (local address 127.17.132.60:45925)
0811 01:38:18.831582 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.831591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.832392 (+ 801us) server_negotiation.cc:407] Connection header received
0811 01:38:18.836526 (+ 4134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.836536 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.836645 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.836727 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.839622 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.841135 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.844469 (+ 3334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.845356 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.845482 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.852168 (+ 6686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.852176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.852182 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.852235 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.856746 (+ 4511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.857894 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.857900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.857903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.858131 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.858752 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.858758 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.858762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.859122 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.859286 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.860320 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.860630 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:38:18.862936 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.830894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.17.132.1:56291)
0811 01:38:18.832219 (+ 1325us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.832275 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.835327 (+ 3052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.837282 (+ 1955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.837302 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.838322 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.839298 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.839404 (+ 106us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.841470 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.841478 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.844260 (+ 2782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.844281 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.845962 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.845971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.846377 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.847357 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.847409 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.851854 (+ 4445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.856935 (+ 5081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.856946 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.856970 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.857710 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.858287 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.858292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.858296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.858596 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.859274 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.859284 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.859838 (+ 554us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.860179 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.860813 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"thread_start_us":4744,"threads_started":1}
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412298, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412298, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:18.865367 25707 heartbeater.cc:347] Connected to a master server at 127.17.132.60:45925
I20260811 01:38:18.865764 25707 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:18.867072 25707 heartbeater.cc:511] Master 127.17.132.60:45925 requested a full tablet report, sending...
Aug 11 01:38:18 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.2@KRBTEST.COM
I20260811 01:38:18.869956 25512 ts_manager.cc:194] Registered new tserver with Master: e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777)
I20260811 01:38:18.873456 25713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.830895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.17.132.1:34495)
0811 01:38:18.836057 (+ 5162us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.836080 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.836228 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.854318 (+ 18090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.854323 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.854790 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.855221 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.855237 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.856918 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.856926 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.858705 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.858718 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.860877 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.860883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.861080 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.861737 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.861806 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.864754 (+ 2948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.869874 (+ 5120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.869882 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.869888 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.870498 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.871106 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.871112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.871116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.871300 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.872560 (+ 1260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.872565 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.872741 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.872884 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.873149 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4998,"mutex_wait_us":399,"thread_start_us":522,"threads_started":1}
I20260811 01:38:18.874460 25712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.830444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:34495 (local address 127.17.132.61:45945)
0811 01:38:18.853901 (+ 23457us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.853907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.853933 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:38:18.853996 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.854002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.854097 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.854296 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.855447 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.856739 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.858861 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.859553 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.861420 (+ 1867us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.865015 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.865022 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.865027 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.865080 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.869668 (+ 4588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.870780 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.870786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.870790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.870952 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.872028 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.872033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.872038 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.872415 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.872595 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.873765 (+ 1170us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.874058 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23299,"thread_start_us":23115,"threads_started":1}
I20260811 01:38:18.875092 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.832769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:37921)
0811 01:38:18.850619 (+ 17850us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:18.850639 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:18.850825 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:18.851283 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:18.851291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:18.852145 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:18.852551 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.852570 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.855975 (+ 3405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.855980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.858998 (+ 3018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:18.859009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.861437 (+ 2428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.861443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:18.861679 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.862312 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:18.862337 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:18.866220 (+ 3883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:18.871413 (+ 5193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.871417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.871421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.871830 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.872653 (+ 823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:18.872658 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:18.872661 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:18.872803 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:18.873571 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:18.873576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:18.873755 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 01:38:18.873914 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 01:38:18.874210 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17702,"mutex_wait_us":1,"thread_start_us":17521,"threads_started":1}
I20260811 01:38:18.875488 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.833158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:37921 (local address 127.17.132.62:40975)
0811 01:38:18.849963 (+ 16805us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.849974 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.850896 (+ 922us) server_negotiation.cc:407] Connection header received
0811 01:38:18.850976 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.850981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.851068 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.851198 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.853048 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.855064 (+ 2016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.859721 (+ 4657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.860439 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.860572 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.866480 (+ 5908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.866487 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.866492 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.866551 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.871261 (+ 4710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.871976 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.871983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.871987 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.872184 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.872940 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.872945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.872948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.873396 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.873569 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.874869 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.875112 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13973,"thread_start_us":13824,"threads_started":1}
I20260811 01:38:18.875523 25710 heartbeater.cc:347] Connected to a master server at 127.17.132.61:45945
I20260811 01:38:18.875679 25710 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:18.876252 25710 heartbeater.cc:511] Master 127.17.132.61:45945 requested a full tablet report, sending...
I20260811 01:38:18.876803 25709 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:18.876950 25709 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:18.877177 25716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:18.831606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42840 (local address 127.17.132.2:46333)
0811 01:38:18.852627 (+ 21021us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:18.852638 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:18.852670 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:18.852743 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:18.852753 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:18.853058 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:18.853231 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:18.855941 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.857687 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.859677 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:18.860433 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:18.860573 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:18.869059 (+ 8486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:18.869080 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:18.869097 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:18.869168 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:18.872659 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.874108 (+ 1449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.874119 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.874125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.874301 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:18.874840 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:18.874845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:18.874849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:18.875397 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:18.875788 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:18.876401 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 01:38:18.876699 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20801,"thread_start_us":20608,"threads_started":1}
I20260811 01:38:18.877424 25709 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:18.878160 25297 ts_manager.cc:194] Registered new tserver with Master: e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777)
I20260811 01:38:18.879158 24989 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:18.879523 24643 ts_manager.cc:194] Re-registered known tserver with Master: e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777)
I20260811 01:38:18.881163 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:37921
I20260811 01:38:18.973011 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24855
I20260811 01:38:18.995052 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:46333
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:40975
--webserver_port=45365
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:19.179896 25587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: NON_VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: true } } }
I20260811 01:38:19.180486 25587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:19.182761 25722 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: attempting to promote NON_VOTER c022054a18ff4792a2491ac8ab6c6551 to VOTER
I20260811 01:38:19.183473 25722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } }
I20260811 01:38:19.185606 25523 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 LEARNER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 01:38:19.185724 25308 raft_consensus.cc:1261] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Refusing update from remote peer 73c62fe0c43e4b1c8893cd499928a2a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 01:38:19.186393 25724 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 01:38:19.186985 25587 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 01:38:19.189746 25587 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.190495 25308 raft_consensus.cc:2932] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.194054 25587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.194340 25587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:19.194918 25587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.195230 25587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:19.201687 25728 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.202461 25728 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:38:19.202739 25522 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.203354 25722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.203621 25722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:19.207981 25553 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:19.208267 25553 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:38:19.366133 25721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:19.366425 25721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:19.366580 25721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:19.374197 25721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:19.374321 25721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:19.374500 25721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:19.384948 25721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:46333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=45365
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:19.386482 25721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:19.387861 25721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:19.402257 25735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:19.402271 25737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:19.402293 25734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:19.404023 25721 server_base.cc:1034] running on GCE node
I20260811 01:38:19.404783 25721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:19.405973 25721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:19.407258 25721 hybrid_clock.cc:648] HybridClock initialized: now 1786412299407200 us; error 56 us; skew 500 ppm
I20260811 01:38:19.407658 25721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:19 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412299, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:19.411415 25721 init.cc:377] Logged in from keytab as oryx/127.17.132.2@KRBTEST.COM (short username oryx)
I20260811 01:38:19.413128 25721 webserver.cc:460] Webserver started at http://127.17.132.2:45365/ using document root <none> and password file <none>
I20260811 01:38:19.414022 25721 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:19.414198 25721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:19.420923 25721 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:38:19.424211 25744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:19.426002 25721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:19.426203 25721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "44b89f62d0e544419dde3fbf63318a47"
format_stamp: "Formatted at 2026-08-11 01:38:15 on dist-test-slave-0kls"
server_key: "33b84fbf022379fc6b8fac49f91005fd"
server_key_iv: "2b30e19f254b05a48a3214de3b0fe141"
server_key_version: "encryptionkey@0"
I20260811 01:38:19.427289 25721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:19.453487 25721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:19.458575 25721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:19.458930 25721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:19.460076 25721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:19.461591 25721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:19.461681 25721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:19.461866 25721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:19.461953 25721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:19.497828 25721 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:46333
I20260811 01:38:19.497956 25865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:46333 every 8 connection(s)
I20260811 01:38:19.499590 25721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:19.504170 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25721
I20260811 01:38:19.504515 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25001
Aug 11 01:38:19 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412299, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
Aug 11 01:38:19 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412299, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
Aug 11 01:38:19 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412299, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
Aug 11 01:38:19 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.3@KRBTEST.COM
I20260811 01:38:19.545490 25871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.503313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:46557 (local address 127.17.132.60:45925)
0811 01:38:19.520295 (+ 16982us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:19.520304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:19.520330 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:38:19.520407 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:19.520414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:19.520510 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:19.520639 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:19.524154 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.525469 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.528611 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.529308 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.529420 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.536438 (+ 7018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:19.536447 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:19.536452 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:19.536503 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:19.540537 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.542377 (+ 1840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.542384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.542387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.542569 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.543109 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.543114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.543118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.543529 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:19.543725 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:19.544772 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0811 01:38:19.545086 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16806,"thread_start_us":16664,"threads_started":1}
I20260811 01:38:19.546546 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.506077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:59003 (local address 127.17.132.62:40975)
0811 01:38:19.521804 (+ 15727us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:19.521812 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:19.524804 (+ 2992us) server_negotiation.cc:407] Connection header received
0811 01:38:19.524883 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:19.524888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:19.524970 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:19.525078 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:19.526461 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.527619 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.529701 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.530373 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.530511 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.537563 (+ 7052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:19.537569 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:19.537572 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:19.537609 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:19.540987 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.542566 (+ 1579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.542574 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.542578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.542807 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.543272 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.543277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.543281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.543664 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:19.543820 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:19.545896 (+ 2076us) server_negotiation.cc:299] Negotiation successful
0811 01:38:19.546160 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15556,"thread_start_us":15440,"threads_started":1}
I20260811 01:38:19.547025 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.505746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:59003)
0811 01:38:19.524156 (+ 18410us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:19.524178 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:19.524351 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:19.525268 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:19.525273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:19.525929 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:19.526273 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.526283 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.527813 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.527820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.529500 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.529515 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.531413 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.531424 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.531700 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.532552 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:19.532574 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:19.537315 (+ 4741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:19.541732 (+ 4417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.541739 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.541744 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.542406 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.542942 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.542948 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.542956 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.543158 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.543841 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:19.543851 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:19.545175 (+ 1324us) client_negotiation.cc:769] Sending connection context
0811 01:38:19.545338 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 01:38:19.545626 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17494,"mutex_wait_us":1039,"thread_start_us":12087,"threads_started":1}
I20260811 01:38:19.547536 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.503173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:46089 (local address 127.17.132.61:45945)
0811 01:38:19.518503 (+ 15330us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:19.518513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:19.520958 (+ 2445us) server_negotiation.cc:407] Connection header received
0811 01:38:19.521035 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:19.521041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:19.521120 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:19.521239 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:19.524195 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.525430 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.528682 (+ 3252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.529357 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.529499 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.536463 (+ 6964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:19.536471 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:19.536475 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:19.536527 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:19.540687 (+ 4160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.541668 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.541675 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.541681 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.541932 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.543308 (+ 1376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.543313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.543317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.543696 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:19.544110 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:19.546890 (+ 2780us) server_negotiation.cc:299] Negotiation successful
0811 01:38:19.547159 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15129,"thread_start_us":15349,"threads_started":1}
I20260811 01:38:19.548055 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.503908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.17.132.2:46089)
0811 01:38:19.520676 (+ 16768us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:19.520699 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:19.520836 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:19.521907 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:19.521912 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:19.522531 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:19.523886 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.523913 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.525684 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.525695 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.528410 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.528427 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.529859 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.529866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.530273 (+ 407us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.531468 (+ 1195us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:19.531507 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:19.536172 (+ 4665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:19.540891 (+ 4719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.540903 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.540926 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.541513 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.542545 (+ 1032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.542550 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.542552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.542820 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.544086 (+ 1266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:19.544091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:19.544392 (+ 301us) client_negotiation.cc:769] Sending connection context
0811 01:38:19.544656 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 01:38:19.547616 (+ 2960us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16569,"mutex_wait_us":2846,"spinlock_wait_cycles":30720,"thread_start_us":336,"threads_started":1}
I20260811 01:38:19.548447 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.503908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.17.132.2:46557)
0811 01:38:19.505079 (+ 1171us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:19.505130 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:19.514993 (+ 9863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:19.521251 (+ 6258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:19.521265 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:19.522357 (+ 1092us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:19.523887 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.523919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.525696 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.525704 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.528418 (+ 2714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:19.528433 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.529859 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.529868 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:19.530262 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.532121 (+ 1859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:19.532152 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:19.536057 (+ 3905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:19.541427 (+ 5370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.541432 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.541435 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.542198 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.542775 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:19.542781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:19.542784 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:19.542961 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:19.543869 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:19.543873 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:19.544383 (+ 510us) client_negotiation.cc:769] Sending connection context
0811 01:38:19.544655 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 01:38:19.545316 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":576,"spinlock_wait_cycles":19968,"thread_start_us":18988,"threads_started":1}
I20260811 01:38:19.549659 25867 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:19.549758 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:19.505766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40590 (local address 127.17.132.3:37717)
0811 01:38:19.523843 (+ 18077us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:19.523855 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:19.523889 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:38:19.523963 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:19.523976 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:19.524288 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:19.524558 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:19.526890 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.528465 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.530430 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:19.531298 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:19.531444 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:19.541533 (+ 10089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:19.541558 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:19.541580 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:19.541651 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:19.545965 (+ 4314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.547097 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.547109 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.547225 (+ 116us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.547411 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:19.547916 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:19.547921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:19.547924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:19.548391 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:19.548730 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:19.549127 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 01:38:19.549343 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17857,"thread_start_us":17701,"threads_started":1}
I20260811 01:38:19.549954 25868 heartbeater.cc:347] Connected to a master server at 127.17.132.61:45945
I20260811 01:38:19.550076 25868 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:19.550081 25867 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:19.551172 25867 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:19.551235 25134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:19.551194 25868 heartbeater.cc:511] Master 127.17.132.61:45945 requested a full tablet report, sending...
I20260811 01:38:19.552203 25866 heartbeater.cc:347] Connected to a master server at 127.17.132.60:45925
I20260811 01:38:19.552361 25866 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:19.552853 25866 heartbeater.cc:511] Master 127.17.132.60:45925 requested a full tablet report, sending...
I20260811 01:38:19.554396 24643 ts_manager.cc:194] Re-registered known tserver with Master: 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:19.554545 25297 ts_manager.cc:194] Registered new tserver with Master: 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:19.555608 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:59003
I20260811 01:38:19.556186 25512 ts_manager.cc:194] Registered new tserver with Master: 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:19.643653 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25001
I20260811 01:38:19.665704 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:37717
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:40975
--webserver_port=40601
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:19.883975 25709 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
W20260811 01:38:20.028879 25881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:20.029152 25881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:20.029352 25881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:20.037086 25881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:20.037209 25881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:20.037434 25881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:20.048442 25881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:37717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=40601
--tserver_master_addrs=127.17.132.62:40975,127.17.132.61:45945,127.17.132.60:45925
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:20.050050 25881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:20.051586 25881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:20.065639 25886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:20.065776 25889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:20.065642 25887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:20.066481 25881 server_base.cc:1034] running on GCE node
I20260811 01:38:20.067020 25881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:20.067911 25881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:20.069183 25881 hybrid_clock.cc:648] HybridClock initialized: now 1786412300069083 us; error 31 us; skew 500 ppm
I20260811 01:38:20.069530 25881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:20 dist-test-slave-0kls krb5kdc[24593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412300, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:20.072736 25881 init.cc:377] Logged in from keytab as oryx/127.17.132.3@KRBTEST.COM (short username oryx)
I20260811 01:38:20.074361 25881 webserver.cc:460] Webserver started at http://127.17.132.3:40601/ using document root <none> and password file <none>
I20260811 01:38:20.075075 25881 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:20.075302 25881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:20.080871 25881 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:38:20.083743 25897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:20.085090 25881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:38:20.085278 25881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b"
format_stamp: "Formatted at 2026-08-11 01:38:16 on dist-test-slave-0kls"
server_key: "2ca17dbb537477dd1ce2743cad60eead"
server_key_iv: "b739f850574abc265c491a9925f16781"
server_key_version: "encryptionkey@0"
I20260811 01:38:20.086385 25881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:20.119604 25881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:20.123958 25881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:20.124269 25881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:20.125289 25881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:20.126772 25881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:20.126897 25881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:20.127035 25881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:20.127130 25881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:20.165444 25881 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:37717
I20260811 01:38:20.165570 26018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:37717 every 8 connection(s)
I20260811 01:38:20.167331 25881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:20.174330 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 25881
Aug 11 01:38:20 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412300, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.61@KRBTEST.COM
Aug 11 01:38:20 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412300, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.60@KRBTEST.COM
I20260811 01:38:20.214599 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.173903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.17.132.3:51823)
0811 01:38:20.177968 (+ 4065us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.177996 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.178152 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.179194 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.179203 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.180835 (+ 1632us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:20.181779 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.181842 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.183300 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.183306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.188007 (+ 4701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.188031 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.193755 (+ 5724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.193766 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.194092 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.195432 (+ 1340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:20.195479 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:20.200419 (+ 4940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:20.206814 (+ 6395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.206832 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.206862 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.207686 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.208446 (+ 760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.208455 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.208461 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.208915 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.211137 (+ 2222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:20.211147 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:20.211722 (+ 575us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.212252 (+ 530us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.212921 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3909,"mutex_wait_us":204,"thread_start_us":3736,"threads_started":1}
I20260811 01:38:20.216014 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.174059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:51823 (local address 127.17.132.61:45945)
0811 01:38:20.178774 (+ 4715us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.178781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.178801 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:38:20.178872 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.178882 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.178977 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.179689 (+ 712us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.182089 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.182978 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.192411 (+ 9433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.193390 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.193583 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.200993 (+ 7410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.201005 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.201014 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.201091 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.206489 (+ 5398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.207893 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.207900 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.207903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.208234 (+ 331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.209127 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.209136 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.209142 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.210835 (+ 1693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.211014 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.215316 (+ 4302us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.215629 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4581,"thread_start_us":4445,"threads_started":1}
I20260811 01:38:20.217360 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.172508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:51903 (local address 127.17.132.60:45925)
0811 01:38:20.178263 (+ 5755us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.178273 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.178294 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:38:20.178370 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.178379 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.178480 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.178708 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.182077 (+ 3369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.183263 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.186711 (+ 3448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.187674 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.187829 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.209536 (+ 21707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.209547 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.209555 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.209614 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.213694 (+ 4080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.214954 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.214961 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.214964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.215117 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.215607 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.215611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.215614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.215978 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.216150 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.216736 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.216990 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5598,"thread_start_us":5473,"threads_started":1}
I20260811 01:38:20.218524 26021 heartbeater.cc:347] Connected to a master server at 127.17.132.61:45945
I20260811 01:38:20.218973 26021 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:20.220118 26021 heartbeater.cc:511] Master 127.17.132.61:45945 requested a full tablet report, sending...
I20260811 01:38:20.220999 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.172484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.17.132.3:51903)
0811 01:38:20.173155 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.173177 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.176891 (+ 3714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.179048 (+ 2157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.179063 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.180484 (+ 1421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:20.181775 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.181838 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.183509 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.183518 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.186441 (+ 2923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.186467 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.188342 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.188353 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.188856 (+ 503us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.205144 (+ 16288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:20.205187 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:20.209218 (+ 4031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:20.214216 (+ 4998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.214221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.214225 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.214804 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.215286 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.215290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.215293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.215461 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.216257 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:20.216262 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:20.216439 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.220114 (+ 3675us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.220495 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":41,"spinlock_wait_cycles":62592,"thread_start_us":1586,"threads_started":1}
Aug 11 01:38:20 dist-test-slave-0kls krb5kdc[24593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412300, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:20.222105 26019 heartbeater.cc:347] Connected to a master server at 127.17.132.60:45925
I20260811 01:38:20.222232 26019 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:20.222668 26019 heartbeater.cc:511] Master 127.17.132.60:45925 requested a full tablet report, sending...
I20260811 01:38:20.222774 25297 ts_manager.cc:194] Registered new tserver with Master: e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:20.224365 25512 ts_manager.cc:194] Registered new tserver with Master: e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:20.231259 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.171071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:49069 (local address 127.17.132.62:40975)
0811 01:38:20.171579 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.171584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.172887 (+ 1303us) server_negotiation.cc:407] Connection header received
0811 01:38:20.178471 (+ 5584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.178481 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.178587 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.178717 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.182042 (+ 3325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.183255 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.202993 (+ 19738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.203808 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.203992 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.223553 (+ 19561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.223559 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.223563 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.223607 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.227324 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.228207 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.228212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.228215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.228367 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.229613 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.229620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.229626 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.230017 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.230173 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.230597 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.230817 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":294,"threads_started":1}
I20260811 01:38:20.231274 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.171690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:49069)
0811 01:38:20.172675 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.172738 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.178278 (+ 5540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.179335 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.179341 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.181264 (+ 1923us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:20.181880 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.181891 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.183444 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.183459 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.202705 (+ 19246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.202744 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.213099 (+ 10355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.213118 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.213426 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.215605 (+ 2179us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:20.215636 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:20.223309 (+ 7673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:20.227465 (+ 4156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.227471 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.227475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.228055 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.228491 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:20.228497 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:20.228500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:20.228677 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:20.230131 (+ 1454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:20.230137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:20.230314 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.230459 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.230791 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":33,"thread_start_us":904,"threads_started":1}
I20260811 01:38:20.232700 26020 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40975
I20260811 01:38:20.232879 26020 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:20.233428 26020 heartbeater.cc:511] Master 127.17.132.62:40975 requested a full tablet report, sending...
I20260811 01:38:20.234663 24643 ts_manager.cc:194] Re-registered known tserver with Master: e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:20.235744 24643 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:49069
I20260811 01:38:20.242828 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.184538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57304 (local address 127.17.132.60:45925)
0811 01:38:20.217623 (+ 33085us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.217631 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.217653 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:38:20.217705 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.217709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.217779 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.217905 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.220094 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.221540 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.225920 (+ 4380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.226641 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.226764 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.233142 (+ 6378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.233152 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.233159 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.233207 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.239265 (+ 6058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.240267 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.240275 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.240280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.240459 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.240985 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.240993 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.240998 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.241445 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.241723 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.242175 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.242458 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32963,"thread_start_us":37915,"threads_started":1}
I20260811 01:38:20.244491 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.184219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46942 (local address 127.17.132.62:40975)
0811 01:38:20.223808 (+ 39589us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.223818 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.223839 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:38:20.223896 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.223900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.223985 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.224122 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.227682 (+ 3560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.228672 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.230915 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.231489 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.231617 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.235004 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.235012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.235017 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.235063 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.239028 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.239956 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.239963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.239967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.240142 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.241807 (+ 1665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.241831 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.241837 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.242193 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.242437 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.242790 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.243459 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39444,"thread_start_us":40935,"threads_started":1}
I20260811 01:38:20.246026 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.190730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.17.132.61:45945)
0811 01:38:20.210116 (+ 19386us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.210123 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.225216 (+ 15093us) server_negotiation.cc:407] Connection header received
0811 01:38:20.225283 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.225289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.225360 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.225490 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.228577 (+ 3087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.229416 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.234235 (+ 4819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.234886 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.235024 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.238607 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.238615 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.238620 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.238664 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.242760 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.243645 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.243651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.243655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.243811 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.244250 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.244255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.244279 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.244744 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.245112 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.245394 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.245632 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19254,"thread_start_us":19051,"threads_started":1}
I20260811 01:38:20.248697 24643 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46942:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:20.256500 24643 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:20.303980 26055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.276887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:37717 (local address 127.0.0.1:40594)
0811 01:38:20.288338 (+ 11451us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.288358 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.288495 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.289893 (+ 1398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.289901 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.289941 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:20.290491 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.290508 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.294830 (+ 4322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.294836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.300052 (+ 5216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.300087 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.303137 (+ 3050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.303143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.303291 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.303355 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.303450 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.303619 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11284,"thread_start_us":11081,"threads_started":1}
I20260811 01:38:20.304323 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.277280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40594 (local address 127.17.132.3:37717)
0811 01:38:20.287708 (+ 10428us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.287722 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.288657 (+ 935us) server_negotiation.cc:407] Connection header received
0811 01:38:20.288810 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.288822 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.289212 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.289465 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:20.290769 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.294577 (+ 3808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.300360 (+ 5783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.302545 (+ 2185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.302649 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.302939 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.303547 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.303743 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10166,"thread_start_us":9898,"threads_started":1}
I20260811 01:38:20.309213 25949 tablet_service.cc:1467] Processing CreateTablet for tablet a9073779f5d54b7ea3f4526827037ce1 (DEFAULT_TABLE table=test-table [id=64b1076a0ab9477c8566d888f0d44431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:20.310751 25949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9073779f5d54b7ea3f4526827037ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:20.312037 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.277207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:32777 (local address 127.0.0.1:43428)
0811 01:38:20.302253 (+ 25046us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.302280 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.302459 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.304085 (+ 1626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.304089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.304122 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:20.305329 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.305348 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.307095 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.307101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.309176 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.309197 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.311185 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.311192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.311392 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.311438 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.311533 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.311681 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24864,"thread_start_us":28375,"threads_started":1}
I20260811 01:38:20.313470 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.277729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.17.132.1:32777)
0811 01:38:20.303451 (+ 25722us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.303458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.303485 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:38:20.303571 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.303578 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.303842 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.304097 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:20.305562 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.306937 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.309411 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.310929 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.311076 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.312856 (+ 1780us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.312953 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.313154 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25546,"thread_start_us":26563,"threads_started":1}
I20260811 01:38:20.313555 26060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.288756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42842 (local address 127.17.132.2:46333)
0811 01:38:20.301649 (+ 12893us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.301662 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.307152 (+ 5490us) server_negotiation.cc:407] Connection header received
0811 01:38:20.307250 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.307256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.307463 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.307783 (+ 320us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:20.308223 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.309183 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.311393 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.312444 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.312608 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.312828 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.313062 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.313249 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12308,"thread_start_us":12565,"threads_started":1}
I20260811 01:38:20.313510 26055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.288421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:46333 (local address 127.0.0.1:42842)
0811 01:38:20.304497 (+ 16076us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.304519 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.304643 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.307759 (+ 3116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.307764 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.307793 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:20.308057 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.308074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.309331 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.309338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.311232 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.311248 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.312635 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.312642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.312831 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.312871 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.312976 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.313131 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15850,"thread_start_us":13468,"threads_started":1}
I20260811 01:38:20.317724 25637 tablet_service.cc:1467] Processing CreateTablet for tablet a9073779f5d54b7ea3f4526827037ce1 (DEFAULT_TABLE table=test-table [id=64b1076a0ab9477c8566d888f0d44431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:20.317725 25794 tablet_service.cc:1467] Processing CreateTablet for tablet a9073779f5d54b7ea3f4526827037ce1 (DEFAULT_TABLE table=test-table [id=64b1076a0ab9477c8566d888f0d44431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:20.319358 25637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9073779f5d54b7ea3f4526827037ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:20.319346 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9073779f5d54b7ea3f4526827037ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:20.326772 26061 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Bootstrap starting.
I20260811 01:38:20.329984 26061 tablet_bootstrap.cc:654] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:20.331350 26061 log.cc:824] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:20.334614 26061 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: No bootstrap required, opened a new log
I20260811 01:38:20.334925 26061 ts_tablet_manager.cc:1397] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20260811 01:38:20.336272 26063 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Bootstrap starting.
I20260811 01:38:20.341209 26063 tablet_bootstrap.cc:654] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:20.342304 26064 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Bootstrap starting.
I20260811 01:38:20.342712 26063 log.cc:824] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:20.346351 26063 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: No bootstrap required, opened a new log
I20260811 01:38:20.346659 26063 ts_tablet_manager.cc:1397] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260811 01:38:20.346318 26061 raft_consensus.cc:348] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.346897 26061 raft_consensus.cc:374] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:20.347019 26061 raft_consensus.cc:729] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e5d6a73d7a4ec8a81a77a4627f765b, State: Initialized, Role: FOLLOWER
I20260811 01:38:20.347729 26061 consensus_queue.cc:260] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.348976 26064 tablet_bootstrap.cc:654] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:20.349653 26061 ts_tablet_manager.cc:1428] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260811 01:38:20.350088 26020 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
I20260811 01:38:20.350395 26064 log.cc:824] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:20.354182 26064 tablet_bootstrap.cc:492] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: No bootstrap required, opened a new log
I20260811 01:38:20.354578 26064 ts_tablet_manager.cc:1397] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260811 01:38:20.360143 26063 raft_consensus.cc:348] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.360597 26063 raft_consensus.cc:374] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:20.360726 26063 raft_consensus.cc:729] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b89f62d0e544419dde3fbf63318a47, State: Initialized, Role: FOLLOWER
I20260811 01:38:20.361399 26063 consensus_queue.cc:260] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.362708 25867 heartbeater.cc:503] Master 127.17.132.62:40975 was elected leader, sending a full tablet report...
I20260811 01:38:20.363157 26064 raft_consensus.cc:348] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.363472 26063 ts_tablet_manager.cc:1428] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Time spent starting tablet: real 0.017s user 0.002s sys 0.011s
I20260811 01:38:20.363605 26064 raft_consensus.cc:374] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:20.363720 26064 raft_consensus.cc:729] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4fb70e5e6274b8b9b00f38e2ccc42f7, State: Initialized, Role: FOLLOWER
I20260811 01:38:20.364353 26064 consensus_queue.cc:260] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.367491 26064 ts_tablet_manager.cc:1428] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
W20260811 01:38:20.421222 26022 tablet.cc:2369] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:38:20.503839 25869 tablet.cc:2369] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:20.564688 26066 raft_consensus.cc:482] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:20.565042 26066 raft_consensus.cc:504] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.567294 26066 leader_election.cc:288] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777), 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:20.575438 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.567906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:52717 (local address 127.17.132.1:32777)
0811 01:38:20.568104 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.568111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.568552 (+ 441us) server_negotiation.cc:407] Connection header received
0811 01:38:20.568631 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.568643 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.568714 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.568794 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:20.569346 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.570440 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.572862 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.574244 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.574410 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.574614 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.574989 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.575152 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:38:20.575518 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.567680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:46333 (local address 127.17.132.3:50029)
0811 01:38:20.568089 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.568111 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.568250 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.568722 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.568727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.568753 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:20.568936 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.568944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.570501 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.570508 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.572855 (+ 2347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.572871 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.574721 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.574727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.574954 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.574996 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.575095 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.575230 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":4}
I20260811 01:38:20.575981 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.567718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:32777 (local address 127.17.132.3:52717)
0811 01:38:20.568313 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:20.568330 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:20.568449 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:20.568961 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:20.568966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:20.568991 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:20.569171 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.569180 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.570605 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.570617 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.572688 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:20.572702 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.574456 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.574462 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:20.574744 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.574812 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 01:38:20.574934 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:38:20.575099 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":6}
I20260811 01:38:20.576361 26060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.568178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:50029 (local address 127.17.132.2:46333)
0811 01:38:20.568419 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.568423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.568438 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:38:20.568501 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.568505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.568570 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.568698 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:20.569095 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.570312 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.573081 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.574506 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.574681 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.574751 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.575414 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.575563 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:38:20.577346 25816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9073779f5d54b7ea3f4526827037ce1" candidate_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b89f62d0e544419dde3fbf63318a47" is_pre_election: true
I20260811 01:38:20.577340 25658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9073779f5d54b7ea3f4526827037ce1" candidate_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" is_pre_election: true
I20260811 01:38:20.577914 25816 raft_consensus.cc:2454] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e5d6a73d7a4ec8a81a77a4627f765b in term 0.
I20260811 01:38:20.577951 25658 raft_consensus.cc:2454] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e5d6a73d7a4ec8a81a77a4627f765b in term 0.
I20260811 01:38:20.578661 25899 leader_election.cc:302] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b89f62d0e544419dde3fbf63318a47, e6e5d6a73d7a4ec8a81a77a4627f765b; no voters:
I20260811 01:38:20.579123 26066 raft_consensus.cc:2781] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:20.579284 26066 raft_consensus.cc:482] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:20.579399 26066 raft_consensus.cc:3037] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:20.581689 26066 raft_consensus.cc:504] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
I20260811 01:38:20.582571 26066 leader_election.cc:288] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [CANDIDATE]: Term 1 election: Requested vote from peers e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777), 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333)
I20260811 01:38:20.583127 25658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9073779f5d54b7ea3f4526827037ce1" candidate_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7"
I20260811 01:38:20.583171 25816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9073779f5d54b7ea3f4526827037ce1" candidate_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b89f62d0e544419dde3fbf63318a47"
I20260811 01:38:20.583380 25658 raft_consensus.cc:3037] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:20.583384 25816 raft_consensus.cc:3037] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:20.586915 25658 raft_consensus.cc:2454] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e5d6a73d7a4ec8a81a77a4627f765b in term 1.
I20260811 01:38:20.586915 25816 raft_consensus.cc:2454] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e5d6a73d7a4ec8a81a77a4627f765b in term 1.
I20260811 01:38:20.587445 25899 leader_election.cc:302] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b89f62d0e544419dde3fbf63318a47, e6e5d6a73d7a4ec8a81a77a4627f765b; no voters:
I20260811 01:38:20.587826 26066 raft_consensus.cc:2781] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:20.588348 26066 raft_consensus.cc:686] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 LEADER]: Becoming Leader. State: Replica: e6e5d6a73d7a4ec8a81a77a4627f765b, State: Running, Role: LEADER
I20260811 01:38:20.589004 26066 consensus_queue.cc:237] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } }
W20260811 01:38:20.590216 25711 tablet.cc:2369] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:20.595793 24643 catalog_manager.cc:5495] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3). New cstate: current_term: 1 leader_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } health_report { overall_health: UNKNOWN } } }
I20260811 01:38:20.657225 26057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.651150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35418 (local address 127.17.132.3:37717)
0811 01:38:20.651363 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.651368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.651492 (+ 124us) server_negotiation.cc:407] Connection header received
0811 01:38:20.651691 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.651695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.651779 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.651912 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:20.652366 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.653199 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.654903 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.655479 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.655578 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.656040 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:20.656699 (+ 659us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:20.656818 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.656897 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.656966 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:38:20.666062 25658 raft_consensus.cc:1261] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Refusing update from remote peer e6e5d6a73d7a4ec8a81a77a4627f765b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:20.666059 25816 raft_consensus.cc:1261] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Refusing update from remote peer e6e5d6a73d7a4ec8a81a77a4627f765b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:20.667136 26070 consensus_queue.cc:1035] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:20.667632 26066 consensus_queue.cc:1035] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:20.683775 26076 mvcc.cc:205] Tried to move back new op lower bound from 7317144783517138944 to 7317144783217336320. Current Snapshot: MvccSnapshot[applied={T|T < 7317144783517138944}]
I20260811 01:38:20.709240 24643 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:20.709565 24643 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:20.718258 24643 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73c62fe0c43e4b1c8893cd499928a2a0: Sending DeleteTablet for 3 replicas of tablet a9073779f5d54b7ea3f4526827037ce1
I20260811 01:38:20.719481 25949 tablet_service.cc:1514] Processing DeleteTablet for tablet a9073779f5d54b7ea3f4526827037ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:20 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:40594
I20260811 01:38:20.719893 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet a9073779f5d54b7ea3f4526827037ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:20 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:42842
I20260811 01:38:20.720304 25637 tablet_service.cc:1514] Processing DeleteTablet for tablet a9073779f5d54b7ea3f4526827037ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:20 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:43428
I20260811 01:38:20.721956 26087 tablet_replica.cc:330] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: stopping tablet replica
I20260811 01:38:20.723407 26087 raft_consensus.cc:2229] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:20.724203 26087 raft_consensus.cc:2258] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:20.726692 26087 ts_tablet_manager.cc:1905] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:20.731942 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 24606
I20260811 01:38:20.733157 24674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:20.752068 26089 tablet_replica.cc:330] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: stopping tablet replica
I20260811 01:38:20.752715 26089 raft_consensus.cc:2229] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:20.753993 26087 ts_tablet_manager.cc:1918] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:20.754242 26087 log.cc:1196] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/a9073779f5d54b7ea3f4526827037ce1
I20260811 01:38:20.754930 26087 ts_tablet_manager.cc:1939] T a9073779f5d54b7ea3f4526827037ce1 P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting consensus metadata
I20260811 01:38:20.756035 26089 raft_consensus.cc:2258] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:20.757819 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.722845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47870 (local address 127.17.132.61:45945)
0811 01:38:20.723077 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.723086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.730758 (+ 7672us) server_negotiation.cc:407] Connection header received
0811 01:38:20.731099 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.731106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.731231 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.731313 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.734957 (+ 3644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.736098 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.739563 (+ 3465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.740261 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.740370 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.748296 (+ 7926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.748304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.748311 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.748377 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.752203 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.753136 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.753143 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.753147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.753313 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.755766 (+ 2453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.755772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.755776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.756190 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.756442 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.757164 (+ 722us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.757431 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:38:20.757865 26088 tablet_replica.cc:330] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: stopping tablet replica
I20260811 01:38:20.760669 26088 raft_consensus.cc:2229] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:20.761245 26088 raft_consensus.cc:2258] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:20.763512 26088 ts_tablet_manager.cc:1905] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:20.771586 26088 ts_tablet_manager.cc:1918] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:20.771817 26088 log.cc:1196] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/a9073779f5d54b7ea3f4526827037ce1
I20260811 01:38:20.772446 26088 ts_tablet_manager.cc:1939] T a9073779f5d54b7ea3f4526827037ce1 P 44b89f62d0e544419dde3fbf63318a47: Deleting consensus metadata
I20260811 01:38:20.777136 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.730927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35064 (local address 127.17.132.60:45925)
0811 01:38:20.731105 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.731111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.758864 (+ 27753us) server_negotiation.cc:407] Connection header received
0811 01:38:20.759045 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.759050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.759139 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.759235 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.762602 (+ 3367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.763353 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.765347 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.765831 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.765981 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.770283 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.770289 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.770292 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.770336 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.773277 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.774530 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.774536 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.774539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.774755 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.775269 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.775275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.775278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.775721 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.776003 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.776487 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.776753 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:38:20.778062 26089 ts_tablet_manager.cc:1905] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:20.786391 26089 ts_tablet_manager.cc:1918] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:20.786589 26089 log.cc:1196] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/a9073779f5d54b7ea3f4526827037ce1
I20260811 01:38:20.787281 26089 ts_tablet_manager.cc:1939] T a9073779f5d54b7ea3f4526827037ce1 P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting consensus metadata
I20260811 01:38:20.907024 24626 catalog_manager.cc:4841] TS e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777): tablet a9073779f5d54b7ea3f4526827037ce1 (table test-table [id=64b1076a0ab9477c8566d888f0d44431]) successfully deleted
I20260811 01:38:20.907323 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 24606
W20260811 01:38:20.940706 25899 connection.cc:535] server connection from 127.0.0.1:40594 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:38:20.970423 26038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.946737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47876 (local address 127.17.132.61:45945)
0811 01:38:20.946981 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.946991 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.950328 (+ 3337us) server_negotiation.cc:407] Connection header received
0811 01:38:20.950503 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.950510 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.950633 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.950732 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.953459 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.954598 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.957218 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.957973 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.958109 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.963122 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.963128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.963132 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.963174 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.966823 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.967790 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.967797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.967801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.967993 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.968465 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.968472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.968478 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.968842 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.969080 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.969732 (+ 652us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.970000 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:38:20.971055 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:20.945640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35066 (local address 127.17.132.60:45925)
0811 01:38:20.945985 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:20.945994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:20.947356 (+ 1362us) server_negotiation.cc:407] Connection header received
0811 01:38:20.947693 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:20.947703 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:20.947821 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:20.947914 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:20.951468 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.952775 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.954787 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:20.955317 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:20.955472 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:20.963787 (+ 8315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:20.963793 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:20.963796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:20.963834 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:20.967342 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.968250 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.968257 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.968260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.968436 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:20.968874 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:20.968883 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:20.968889 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:20.969275 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:20.969526 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:20.970040 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 01:38:20.970296 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 01:38:21.691026 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:21.690118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:40839)
0811 01:38:21.690670 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:21.690838 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":321,"threads_started":1}
W20260811 01:38:21.691674 25709 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:40975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:21.693250 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:21.692477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:53837)
0811 01:38:21.692899 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:21.693012 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":213,"threads_started":1}
W20260811 01:38:21.693763 25867 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:40975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:21.704589 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:21.703604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:37907)
0811 01:38:21.704117 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:21.704299 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":275,"threads_started":1}
W20260811 01:38:21.705017 26020 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:40975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:22.217841 26104 raft_consensus.cc:482] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73c62fe0c43e4b1c8893cd499928a2a0)
I20260811 01:38:22.218142 26105 raft_consensus.cc:482] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73c62fe0c43e4b1c8893cd499928a2a0)
I20260811 01:38:22.218168 26104 raft_consensus.cc:504] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } }
I20260811 01:38:22.218400 26105 raft_consensus.cc:504] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } }
I20260811 01:38:22.219323 26105 leader_election.cc:288] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975), c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60:45925)
I20260811 01:38:22.219892 26104 leader_election.cc:288] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975), db6255f5279e423782f765b655f901ab (127.17.132.61:45945)
I20260811 01:38:22.220779 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.219461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43454)
0811 01:38:22.220248 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.220435 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":481,"threads_started":1}
W20260811 01:38:22.221105 25283 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:22.222103 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.220410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43458)
0811 01:38:22.221491 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.221741 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":901,"thread_start_us":711,"threads_started":1}
I20260811 01:38:22.224653 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.223319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43474)
0811 01:38:22.224052 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.224358 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":577}
W20260811 01:38:22.224958 25497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
W20260811 01:38:22.225236 25283 leader_election.cc:334] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975): Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:22.227337 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.226500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43486)
0811 01:38:22.227006 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.227147 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":289,"threads_started":1}
W20260811 01:38:22.227566 25497 leader_election.cc:334] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975): Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:22.230754 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.221387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35076 (local address 127.17.132.60:45925)
0811 01:38:22.223608 (+ 2221us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.223617 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.223644 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:38:22.223744 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.223749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.223827 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.223942 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.224520 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.225950 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.228317 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.229602 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.229731 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.229869 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.230290 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.230413 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":2060,"thread_start_us":1888,"threads_started":1}
I20260811 01:38:22.230790 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.219581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:45925 (local address 127.0.0.1:35076)
0811 01:38:22.222837 (+ 3256us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.222866 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.223064 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.224001 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.224006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.224044 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.224313 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.224329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.226118 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.226123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.228160 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.228179 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.229855 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.229863 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.230031 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.230121 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.230246 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.230416 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3115,"thread_start_us":4145,"threads_started":1}
I20260811 01:38:22.231559 25522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db6255f5279e423782f765b655f901ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c022054a18ff4792a2491ac8ab6c6551" is_pre_election: true
I20260811 01:38:22.231967 25522 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db6255f5279e423782f765b655f901ab in term 1.
I20260811 01:38:22.232429 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.224276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:45945 (local address 127.0.0.1:47878)
0811 01:38:22.224430 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.224448 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.224570 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.225760 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.225766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.225833 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.226270 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.226307 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.227942 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.227946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.229987 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.229998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.231609 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.231616 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.231830 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.231864 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.231998 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.232145 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":39}
I20260811 01:38:22.232590 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.223598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47878 (local address 127.17.132.61:45945)
0811 01:38:22.225407 (+ 1809us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.225413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.225437 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:38:22.225494 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.225500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.225581 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.225885 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.226477 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.227815 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.230167 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.231430 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.231527 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.231690 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.232022 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.232176 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1660,"thread_start_us":1457,"threads_started":1}
I20260811 01:38:22.232546 25281 leader_election.cc:302] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c022054a18ff4792a2491ac8ab6c6551, db6255f5279e423782f765b655f901ab; no voters: 73c62fe0c43e4b1c8893cd499928a2a0
I20260811 01:38:22.232939 26105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 01:38:22.233086 26105 raft_consensus.cc:482] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73c62fe0c43e4b1c8893cd499928a2a0)
I20260811 01:38:22.233229 26105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:38:22.233330 25308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c022054a18ff4792a2491ac8ab6c6551" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "db6255f5279e423782f765b655f901ab" is_pre_election: true
I20260811 01:38:22.235489 26105 raft_consensus.cc:504] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } }
I20260811 01:38:22.235945 25308 raft_consensus.cc:2379] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c022054a18ff4792a2491ac8ab6c6551 in current term 2: Already voted for candidate db6255f5279e423782f765b655f901ab in this term.
I20260811 01:38:22.236268 26105 leader_election.cc:288] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 election: Requested vote from peers 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975), c022054a18ff4792a2491ac8ab6c6551 (127.17.132.60:45925)
I20260811 01:38:22.236866 25522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db6255f5279e423782f765b655f901ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c022054a18ff4792a2491ac8ab6c6551"
I20260811 01:38:22.237030 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.236390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43496)
0811 01:38:22.236774 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.236875 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227}
I20260811 01:38:22.236989 25497 leader_election.cc:302] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c022054a18ff4792a2491ac8ab6c6551; no voters: 73c62fe0c43e4b1c8893cd499928a2a0, db6255f5279e423782f765b655f901ab
I20260811 01:38:22.237139 25522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:38:22.238075 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.237673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43500)
0811 01:38:22.237896 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.237980 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 01:38:22.238317 25283 leader_election.cc:334] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975): Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
I20260811 01:38:22.239670 25522 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db6255f5279e423782f765b655f901ab in term 2.
I20260811 01:38:22.239892 26104 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:38:22.240118 25281 leader_election.cc:302] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c022054a18ff4792a2491ac8ab6c6551, db6255f5279e423782f765b655f901ab; no voters: 73c62fe0c43e4b1c8893cd499928a2a0
I20260811 01:38:22.240430 26105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:38:22.240868 26105 raft_consensus.cc:686] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [term 2 LEADER]: Becoming Leader. State: Replica: db6255f5279e423782f765b655f901ab, State: Running, Role: LEADER
I20260811 01:38:22.241376 26105 consensus_queue.cc:237] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } }
I20260811 01:38:22.243809 26114 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader db6255f5279e423782f765b655f901ab. Latest consensus state: current_term: 2 leader_uuid: "db6255f5279e423782f765b655f901ab" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:22.244275 26114 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:22.245098 26117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:22.250567 26117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:22.251663 26117 catalog_manager.cc:1259] Loaded cluster ID: 66ecc8464f0b4f7f97d8345b89369eeb
I20260811 01:38:22.251739 26117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:22.252978 26117 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:22.253994 26117 catalog_manager.cc:5879] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Loaded TSK: 0
I20260811 01:38:22.254963 26117 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:22.269629 25297 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:22.277369 25297 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:22.282160 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.281542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43516)
0811 01:38:22.281800 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.281937 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 01:38:22.282202 25522 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [term 2 FOLLOWER]: Refusing update from remote peer db6255f5279e423782f765b655f901ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 01:38:22.283043 26114 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 01:38:22.283360 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.282946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43520)
0811 01:38:22.283117 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.283216 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:38:22.283614 25283 consensus_peers.cc:487] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab -> Peer 73c62fe0c43e4b1c8893cd499928a2a0 (127.17.132.62:40975): Couldn't send request to peer 73c62fe0c43e4b1c8893cd499928a2a0. Status: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 01:38:22.285971 26104 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db6255f5279e423782f765b655f901ab. Latest consensus state: current_term: 2 leader_uuid: "db6255f5279e423782f765b655f901ab" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:22.286266 26104 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:38:22.288554 26104 sys_catalog.cc:455] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "db6255f5279e423782f765b655f901ab" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:22.288856 26104 sys_catalog.cc:458] T 00000000000000000000000000000000 P c022054a18ff4792a2491ac8ab6c6551 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:38:22.288998 26105 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "db6255f5279e423782f765b655f901ab" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "73c62fe0c43e4b1c8893cd499928a2a0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40975 } } peers { permanent_uuid: "db6255f5279e423782f765b655f901ab" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 45945 } attrs { promote: false } } peers { permanent_uuid: "c022054a18ff4792a2491ac8ab6c6551" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 45925 } attrs { promote: false } } }
I20260811 01:38:22.289402 26105 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:22.307494 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.298736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50232 (local address 127.17.132.1:32777)
0811 01:38:22.299209 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.299216 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.299240 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:38:22.299319 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.299324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.299404 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.300566 (+ 1162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.300793 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.302289 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.304849 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.306167 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.306677 (+ 510us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.306795 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.307020 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.307168 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":531,"threads_started":1}
I20260811 01:38:22.307548 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.298582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:32777 (local address 127.0.0.1:50232)
0811 01:38:22.299057 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.299076 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.299188 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.299586 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.299591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.299651 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.300071 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.300087 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.302476 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.302480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.304636 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.304654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.306458 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.306465 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.306785 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.306865 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.306990 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.307157 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":132}
I20260811 01:38:22.307660 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.298252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:46333 (local address 127.0.0.1:36740)
0811 01:38:22.298431 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.298450 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.298590 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.300722 (+ 2132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.300728 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.300762 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.300989 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.301001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.302398 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.302403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.304636 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.304654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.306397 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.306406 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.306762 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.306859 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.306998 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.307195 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":83}
I20260811 01:38:22.308291 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.298413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36740 (local address 127.17.132.2:46333)
0811 01:38:22.300355 (+ 1942us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.300360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.300376 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:38:22.300472 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.300476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.300555 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.301171 (+ 616us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.301368 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.302259 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.304843 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.306154 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.306324 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.306469 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.307786 (+ 1317us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.307957 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1848,"thread_start_us":1717,"threads_started":1}
I20260811 01:38:22.309243 25637 tablet_service.cc:1467] Processing CreateTablet for tablet 15d3024e12884226a7d9d0431a45632a (DEFAULT_TABLE table=test-table [id=d126960fe673496a8caf2035b82a913b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:22.309839 25637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d3024e12884226a7d9d0431a45632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:22.315923 26128 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Bootstrap starting.
I20260811 01:38:22.316300 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 15d3024e12884226a7d9d0431a45632a (DEFAULT_TABLE table=test-table [id=d126960fe673496a8caf2035b82a913b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:22.316788 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d3024e12884226a7d9d0431a45632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:22.318095 26128 tablet_bootstrap.cc:654] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:22.320060 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.299630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:37717 (local address 127.0.0.1:35424)
0811 01:38:22.307832 (+ 8202us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.307855 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.307957 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.314886 (+ 6929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.314894 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.314927 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.315130 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.315146 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.316517 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.316522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.317723 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.317738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.319130 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.319138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.319350 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.319406 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.319489 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.319647 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8079,"thread_start_us":15610,"threads_started":1}
I20260811 01:38:22.320747 26128 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: No bootstrap required, opened a new log
I20260811 01:38:22.320955 26128 ts_tablet_manager.cc:1397] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260811 01:38:22.321259 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.299986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35424 (local address 127.17.132.3:37717)
0811 01:38:22.314437 (+ 14451us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.314447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.314475 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:38:22.314571 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.314579 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.314715 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.314863 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.315298 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.316382 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.317991 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.318879 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.320620 (+ 1741us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.320731 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.320786 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.320937 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14274,"thread_start_us":14141,"threads_started":1}
I20260811 01:38:22.321879 26128 raft_consensus.cc:348] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.322182 26128 raft_consensus.cc:374] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:22.322291 26128 raft_consensus.cc:729] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4fb70e5e6274b8b9b00f38e2ccc42f7, State: Initialized, Role: FOLLOWER
I20260811 01:38:22.322521 25949 tablet_service.cc:1467] Processing CreateTablet for tablet 15d3024e12884226a7d9d0431a45632a (DEFAULT_TABLE table=test-table [id=d126960fe673496a8caf2035b82a913b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:22.322536 26128 consensus_queue.cc:260] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.323004 25949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15d3024e12884226a7d9d0431a45632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:22.323441 26128 ts_tablet_manager.cc:1428] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:38:22.325253 26133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.324052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:46597)
0811 01:38:22.324666 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.324895 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":323,"threads_started":1}
I20260811 01:38:22.326807 26134 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Bootstrap starting.
I20260811 01:38:22.328037 25710 heartbeater.cc:503] Master 127.17.132.61:45945 was elected leader, sending a full tablet report...
I20260811 01:38:22.328997 26134 tablet_bootstrap.cc:654] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:22.330369 26135 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Bootstrap starting.
I20260811 01:38:22.331956 26134 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: No bootstrap required, opened a new log
I20260811 01:38:22.332178 26134 ts_tablet_manager.cc:1397] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.002s
I20260811 01:38:22.332288 26135 tablet_bootstrap.cc:654] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:22.332882 26134 raft_consensus.cc:348] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.333078 26134 raft_consensus.cc:374] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:22.333221 26134 raft_consensus.cc:729] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b89f62d0e544419dde3fbf63318a47, State: Initialized, Role: FOLLOWER
I20260811 01:38:22.333504 26134 consensus_queue.cc:260] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.334457 26134 ts_tablet_manager.cc:1428] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:38:22.335426 26135 tablet_bootstrap.cc:492] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: No bootstrap required, opened a new log
I20260811 01:38:22.335714 26135 ts_tablet_manager.cc:1397] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 01:38:22.336848 26135 raft_consensus.cc:348] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.337252 26135 raft_consensus.cc:374] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:22.337425 26135 raft_consensus.cc:729] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e5d6a73d7a4ec8a81a77a4627f765b, State: Initialized, Role: FOLLOWER
I20260811 01:38:22.337805 26135 consensus_queue.cc:260] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.338876 26135 ts_tablet_manager.cc:1428] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 01:38:22.340101 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.338991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:38333)
0811 01:38:22.339615 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.339792 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":349,"threads_started":1}
I20260811 01:38:22.341871 26021 heartbeater.cc:503] Master 127.17.132.61:45945 was elected leader, sending a full tablet report...
I20260811 01:38:22.342664 25868 heartbeater.cc:503] Master 127.17.132.61:45945 was elected leader, sending a full tablet report...
I20260811 01:38:22.342849 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.342473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:58661)
0811 01:38:22.342612 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.342703 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 01:38:22.343297 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.334849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:36631)
0811 01:38:22.340872 (+ 6023us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.342229 (+ 1357us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5878,"thread_start_us":5744,"threads_started":1}
I20260811 01:38:22.344602 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.344136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:44885)
0811 01:38:22.344329 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.344441 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:38:22.405438 26132 raft_consensus.cc:482] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:22.405718 26132 raft_consensus.cc:504] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.407392 26132 leader_election.cc:288] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333), e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:22.413527 26133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.407883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:46333 (local address 127.17.132.1:41063)
0811 01:38:22.408086 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.408106 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.408270 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.408646 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.408652 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.408678 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.409096 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.409109 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.410216 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.410225 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.411587 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.411599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.412782 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.412789 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.412957 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.412982 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.413094 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.413242 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 01:38:22.413527 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.407884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:41063 (local address 127.17.132.2:46333)
0811 01:38:22.408082 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.408087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.408224 (+ 137us) server_negotiation.cc:407] Connection header received
0811 01:38:22.408441 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.408446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.408507 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.408625 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.409283 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.410083 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.411777 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.412571 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.412765 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.412842 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.413124 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.413274 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:38:22.414495 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.408579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:58139 (local address 127.17.132.3:37717)
0811 01:38:22.408936 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.408941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.409263 (+ 322us) server_negotiation.cc:407] Connection header received
0811 01:38:22.409429 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.409434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.409515 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.409619 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:22.410202 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.410871 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.412518 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.413468 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.413660 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.413737 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.414098 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.414263 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260811 01:38:22.414487 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.408342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:37717 (local address 127.17.132.1:58139)
0811 01:38:22.409153 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.409167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:22.409310 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:22.409647 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:22.409652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:22.409675 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:22.410047 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.410055 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.411013 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.411018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.412362 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:22.412373 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.413696 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.413702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:22.413909 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.413932 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:38:22.414043 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:38:22.414183 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":522,"threads_started":1}
I20260811 01:38:22.414657 25816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d3024e12884226a7d9d0431a45632a" candidate_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b89f62d0e544419dde3fbf63318a47" is_pre_election: true
I20260811 01:38:22.414960 25816 raft_consensus.cc:2454] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4fb70e5e6274b8b9b00f38e2ccc42f7 in term 0.
I20260811 01:38:22.415553 25584 leader_election.cc:302] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b89f62d0e544419dde3fbf63318a47, e4fb70e5e6274b8b9b00f38e2ccc42f7; no voters:
I20260811 01:38:22.415469 25971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d3024e12884226a7d9d0431a45632a" candidate_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" is_pre_election: true
I20260811 01:38:22.415964 25971 raft_consensus.cc:2454] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4fb70e5e6274b8b9b00f38e2ccc42f7 in term 0.
I20260811 01:38:22.416011 26132 raft_consensus.cc:2781] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:22.416147 26132 raft_consensus.cc:482] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:22.416265 26132 raft_consensus.cc:3037] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:22.421103 26132 raft_consensus.cc:504] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.421916 26132 leader_election.cc:288] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [CANDIDATE]: Term 1 election: Requested vote from peers 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333), e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717)
I20260811 01:38:22.422488 25971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d3024e12884226a7d9d0431a45632a" candidate_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b"
I20260811 01:38:22.422503 25816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15d3024e12884226a7d9d0431a45632a" candidate_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b89f62d0e544419dde3fbf63318a47"
I20260811 01:38:22.422727 25971 raft_consensus.cc:3037] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:22.422742 25816 raft_consensus.cc:3037] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:22.425036 25816 raft_consensus.cc:2454] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4fb70e5e6274b8b9b00f38e2ccc42f7 in term 1.
I20260811 01:38:22.425508 25584 leader_election.cc:302] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b89f62d0e544419dde3fbf63318a47, e4fb70e5e6274b8b9b00f38e2ccc42f7; no voters:
I20260811 01:38:22.425881 26132 raft_consensus.cc:2781] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:22.425863 25971 raft_consensus.cc:2454] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4fb70e5e6274b8b9b00f38e2ccc42f7 in term 1.
I20260811 01:38:22.426656 26132 raft_consensus.cc:686] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 LEADER]: Becoming Leader. State: Replica: e4fb70e5e6274b8b9b00f38e2ccc42f7, State: Running, Role: LEADER
I20260811 01:38:22.427778 26132 consensus_queue.cc:237] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } }
I20260811 01:38:22.427999 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.427484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:46197)
0811 01:38:22.427680 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.427815 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 01:38:22.432037 25297 catalog_manager.cc:5495] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1). New cstate: current_term: 1 leader_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4fb70e5e6274b8b9b00f38e2ccc42f7" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 32777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 } health_report { overall_health: UNKNOWN } } }
I20260811 01:38:22.464241 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.459062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50240 (local address 127.17.132.1:32777)
0811 01:38:22.459310 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.459315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.459333 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:38:22.459506 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.459510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.459591 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.459730 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:22.460040 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.460741 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.462098 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.462570 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.462670 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.463054 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:22.463596 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:22.463729 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.463846 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.463914 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 01:38:22.468732 25816 raft_consensus.cc:1261] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Refusing update from remote peer e4fb70e5e6274b8b9b00f38e2ccc42f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:22.469061 25971 raft_consensus.cc:1261] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Refusing update from remote peer e4fb70e5e6274b8b9b00f38e2ccc42f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:22.469616 26143 consensus_queue.cc:1035] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b89f62d0e544419dde3fbf63318a47" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:22.470155 26132 consensus_queue.cc:1035] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e5d6a73d7a4ec8a81a77a4627f765b" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 37717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:22.473304 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.472664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:40703)
0811 01:38:22.472993 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.473117 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260811 01:38:22.474169 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.472358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:33711)
0811 01:38:22.473840 (+ 1482us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.473974 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1348}
I20260811 01:38:22.481455 26139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.480833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.2:55149)
0811 01:38:22.481109 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.481208 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 01:38:22.482918 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.482270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.3:44855)
0811 01:38:22.482570 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.482683 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260811 01:38:22.488236 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.486849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:57731)
0811 01:38:22.487936 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.488038 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":962}
I20260811 01:38:22.490010 26142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.489478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.17.132.1:38825)
0811 01:38:22.489702 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.489823 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 01:38:22.499295 25297 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:22.499626 25297 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:22.507296 25297 catalog_manager.cc:5782] T 00000000000000000000000000000000 P db6255f5279e423782f765b655f901ab: Sending DeleteTablet for 3 replicas of tablet 15d3024e12884226a7d9d0431a45632a
I20260811 01:38:22.508273 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d3024e12884226a7d9d0431a45632a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:22 UTC) from {username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:36740
I20260811 01:38:22.508399 25949 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d3024e12884226a7d9d0431a45632a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:22 UTC) from {username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:35424
I20260811 01:38:22.508400 25637 tablet_service.cc:1514] Processing DeleteTablet for tablet 15d3024e12884226a7d9d0431a45632a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:22 UTC) from {username='oryx', principal='oryx/127.17.132.61@KRBTEST.COM'} at 127.0.0.1:50232
I20260811 01:38:22.510443 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25478
I20260811 01:38:22.522535 26159 tablet_replica.cc:330] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: stopping tablet replica
I20260811 01:38:22.522948 26159 raft_consensus.cc:2229] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:22.523818 26159 raft_consensus.cc:2258] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:22.524456 26158 tablet_replica.cc:330] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: stopping tablet replica
I20260811 01:38:22.524724 26158 raft_consensus.cc:2229] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:22.525228 26158 raft_consensus.cc:2258] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:22.526566 26159 ts_tablet_manager.cc:1905] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:22.528261 26158 ts_tablet_manager.cc:1905] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:22.534484 26159 ts_tablet_manager.cc:1918] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:22.534780 26159 log.cc:1196] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/15d3024e12884226a7d9d0431a45632a
I20260811 01:38:22.535411 26159 ts_tablet_manager.cc:1939] T 15d3024e12884226a7d9d0431a45632a P e4fb70e5e6274b8b9b00f38e2ccc42f7: Deleting consensus metadata
I20260811 01:38:22.536921 25279 catalog_manager.cc:4841] TS e4fb70e5e6274b8b9b00f38e2ccc42f7 (127.17.132.1:32777): tablet 15d3024e12884226a7d9d0431a45632a (table test-table [id=d126960fe673496a8caf2035b82a913b]) successfully deleted
I20260811 01:38:22.544425 26157 tablet_replica.cc:330] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: stopping tablet replica
I20260811 01:38:22.544653 26157 raft_consensus.cc:2229] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:22.547115 26158 ts_tablet_manager.cc:1918] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:22.547323 26158 log.cc:1196] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/15d3024e12884226a7d9d0431a45632a
I20260811 01:38:22.547807 26158 ts_tablet_manager.cc:1939] T 15d3024e12884226a7d9d0431a45632a P e6e5d6a73d7a4ec8a81a77a4627f765b: Deleting consensus metadata
I20260811 01:38:22.548211 26157 raft_consensus.cc:2258] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:22.549899 25280 catalog_manager.cc:4841] TS e6e5d6a73d7a4ec8a81a77a4627f765b (127.17.132.3:37717): tablet 15d3024e12884226a7d9d0431a45632a (table test-table [id=d126960fe673496a8caf2035b82a913b]) successfully deleted
I20260811 01:38:22.550558 26157 ts_tablet_manager.cc:1905] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:22.557982 26157 ts_tablet_manager.cc:1918] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:22.558112 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.511849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50248 (local address 127.17.132.1:32777)
0811 01:38:22.512092 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.512101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.538417 (+ 26316us) server_negotiation.cc:407] Connection header received
0811 01:38:22.538629 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.538638 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.538806 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.538951 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:22.543877 (+ 4926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.545072 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.546936 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.547573 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.547727 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.551053 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:22.551070 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:22.551085 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:22.551132 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:22.554528 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.555403 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.555412 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.555414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.555614 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.556090 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.556101 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.556103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.556601 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:22.556944 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.557254 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.557529 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:38:22.558154 26157 log.cc:1196] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/15d3024e12884226a7d9d0431a45632a
I20260811 01:38:22.558709 26157 ts_tablet_manager.cc:1939] T 15d3024e12884226a7d9d0431a45632a P 44b89f62d0e544419dde3fbf63318a47: Deleting consensus metadata
I20260811 01:38:22.558951 25702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:22.559865 25280 catalog_manager.cc:4841] TS 44b89f62d0e544419dde3fbf63318a47 (127.17.132.2:46333): tablet 15d3024e12884226a7d9d0431a45632a (table test-table [id=d126960fe673496a8caf2035b82a913b]) successfully deleted
I20260811 01:38:22.667945 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25478
I20260811 01:38:22.689569 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25721
I20260811 01:38:22.704419 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.690612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36742 (local address 127.17.132.2:46333)
0811 01:38:22.690795 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.690800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.690839 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:38:22.691049 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.691053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.691151 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.691243 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:22.692743 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.693518 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.695091 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.695482 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.695584 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.698275 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:22.698292 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:22.698310 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:22.698414 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:22.701460 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.702316 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.702323 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.702325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.702476 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.702833 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.702837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.702839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.703316 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:22.703546 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.703850 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.704029 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:38:22.705230 25861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:22.803637 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25721
I20260811 01:38:22.826161 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25881
I20260811 01:38:22.839929 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.826928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35426 (local address 127.17.132.3:37717)
0811 01:38:22.827116 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:22.827121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:22.827139 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:38:22.827280 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:22.827284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:22.827366 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:22.827451 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:22.828814 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.829530 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.830846 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:22.831236 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:22.831329 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:22.833947 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:22.833962 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:22.833979 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:22.834020 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:22.836775 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.837477 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.837484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.837486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.837624 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:22.838267 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:22.838271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:22.838273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:22.838716 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:22.838996 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:22.839304 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 01:38:22.839483 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:38:22.840752 26013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:22.860108 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.859322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43530)
0811 01:38:22.859833 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.859926 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":276,"threads_started":1}
I20260811 01:38:22.861614 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:22.861214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40975 (local address 127.0.0.1:43544)
0811 01:38:22.861388 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:22.861480 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:40975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 01:38:22.964463 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25881
I20260811 01:38:22.991094 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25146
I20260811 01:38:22.992200 25330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:23.119468 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25146
I20260811 01:38:23.146128 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 25258
I20260811 01:38:23.147301 25545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:23.267393 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 25258
2026-08-11T01:38:23Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10549 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:38:23 dist-test-slave-0kls krb5kdc[26170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:38:23 dist-test-slave-0kls krb5kdc[26170](info): set up 2 sockets
Aug 11 01:38:23 dist-test-slave-0kls krb5kdc[26170](info): commencing operation
krb5kdc: starting...
W20260811 01:38:24.442873 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:38:24 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:38:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:24Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab.
Entry for principal oryx/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab.
I20260811 01:38:24.726325 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40501
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab
--principal=oryx/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:25.070984 26188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:25.071343 26188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:25.071514 26188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:25.078825 26188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:25.078981 26188 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:38:25.079080 26188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:25.079211 26188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:25.079300 26188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:25.079393 26188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:25.089721 26188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40501
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.62.keytab
--principal=oryx/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:25.091230 26188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:25.092654 26188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:25.105700 26196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:25.105867 26195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:25.105849 26198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:25.106071 26188 server_base.cc:1034] running on GCE node
I20260811 01:38:25.107221 26188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:25.108645 26188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:25.109956 26188 hybrid_clock.cc:648] HybridClock initialized: now 1786412305109862 us; error 48 us; skew 500 ppm
I20260811 01:38:25.110298 26188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:25 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412305, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:25.113651 26188 init.cc:377] Logged in from keytab as oryx/127.17.132.62@KRBTEST.COM (short username oryx)
I20260811 01:38:25.115355 26188 webserver.cc:460] Webserver started at http://127.17.132.62:34087/ using document root <none> and password file <none>
I20260811 01:38:25.116120 26188 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:25.116214 26188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:25.116590 26188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:25.119843 26188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "7320a9486182474e834b0550bc141d2e"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "21a4f3e2a72179c4479d8af78e215551"
server_key_iv: "00b2009ea1a53194f6d0c9ceadb4c8b4"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.120667 26188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "7320a9486182474e834b0550bc141d2e"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "21a4f3e2a72179c4479d8af78e215551"
server_key_iv: "00b2009ea1a53194f6d0c9ceadb4c8b4"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.126271 26188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:38:25.129946 26205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:25.131287 26188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:25.131462 26188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "7320a9486182474e834b0550bc141d2e"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "21a4f3e2a72179c4479d8af78e215551"
server_key_iv: "00b2009ea1a53194f6d0c9ceadb4c8b4"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.131695 26188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:25.163240 26188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:25.167891 26188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:25.168193 26188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:25.191352 26188 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:40501
I20260811 01:38:25.191372 26274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:40501 every 8 connection(s)
I20260811 01:38:25.192965 26188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:25.193650 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 26188
I20260811 01:38:25.193984 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:25.194890 17936 external_mini_cluster.cc:1428] Setting key 0b8ed9c88d0b53ee6db7a0dda40b7f7b
I20260811 01:38:25.198094 26275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:38:25 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:25.212610 26275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Bootstrap starting.
I20260811 01:38:25.217013 26275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:25.218469 26275 log.cc:824] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:25.221199 26280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:25.197150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47624 (local address 127.17.132.62:40501)
0811 01:38:25.198039 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:25.198053 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:25.198102 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:38:25.199946 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:25.199971 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:25.200379 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:25.200739 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:25.202752 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.204185 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.206046 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.206765 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.206901 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:25.212042 (+ 5141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:25.212056 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:25.212082 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:25.212145 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:25.216174 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.216966 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.216979 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.216990 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.217239 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.217740 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.217745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.217748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.218530 (+ 782us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:25.218842 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:25.219371 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 01:38:25.219843 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":410,"threads_started":1}
I20260811 01:38:25.222100 26275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: No bootstrap required, opened a new log
I20260811 01:38:25.229904 26275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } }
I20260811 01:38:25.230306 26275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:25.230387 26275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7320a9486182474e834b0550bc141d2e, State: Initialized, Role: FOLLOWER
I20260811 01:38:25.231027 26275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } }
I20260811 01:38:25.231312 26275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:25.231482 26275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:25.231681 26275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:25.233853 26275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } }
I20260811 01:38:25.234377 26275 leader_election.cc:302] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7320a9486182474e834b0550bc141d2e; no voters:
I20260811 01:38:25.235015 26275 leader_election.cc:288] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:25.235150 26283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:25.235916 26283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [term 1 LEADER]: Becoming Leader. State: Replica: 7320a9486182474e834b0550bc141d2e, State: Running, Role: LEADER
I20260811 01:38:25.236642 26283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } }
I20260811 01:38:25.237234 26275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:25.240309 26285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7320a9486182474e834b0550bc141d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } } }
I20260811 01:38:25.240767 26285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:25.240600 26286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7320a9486182474e834b0550bc141d2e. Latest consensus state: current_term: 1 leader_uuid: "7320a9486182474e834b0550bc141d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7320a9486182474e834b0550bc141d2e" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40501 } } }
I20260811 01:38:25.240938 26286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:25.244483 26300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:25.250326 26300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:25.259343 26300 catalog_manager.cc:1347] Generated new cluster ID: bc31f08a18a24d738a8dc00614bc7dfd
I20260811 01:38:25.259472 26300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:25.278165 26300 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:25.280216 26300 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:25.289954 26300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Generated new TSK 0
I20260811 01:38:25.290884 26300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
I20260811 01:38:25.365767 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40501
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:25.713598 26314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:25.713994 26314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:25.714104 26314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:25.721604 26314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:25.721726 26314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:25.721880 26314 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:38:25.721973 26314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:25.732161 26314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:25.733456 26314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:25.734889 26314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:25.748618 26321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:25.748667 26326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:25.748657 26323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:25.749548 26314 server_base.cc:1034] running on GCE node
I20260811 01:38:25.750244 26314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:25.751210 26314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:25.752422 26314 hybrid_clock.cc:648] HybridClock initialized: now 1786412305752342 us; error 50 us; skew 500 ppm
I20260811 01:38:25.752733 26314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:25 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412305, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:25.756050 26314 init.cc:377] Logged in from keytab as oryx/127.17.132.1@KRBTEST.COM (short username oryx)
I20260811 01:38:25.757506 26314 webserver.cc:460] Webserver started at http://127.17.132.1:37785/ using document root <none> and password file <none>
I20260811 01:38:25.758296 26314 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:25.758412 26314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:25.758772 26314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:25.762255 26314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "49db151f335bd1d6ba02995bfdab477a"
server_key_iv: "e1ec529c254656161198d935897952e9"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.763168 26314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "49db151f335bd1d6ba02995bfdab477a"
server_key_iv: "e1ec529c254656161198d935897952e9"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.768996 26314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:25.772658 26334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:25.774115 26314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:25.774300 26314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
format_stamp: "Formatted at 2026-08-11 01:38:25 on dist-test-slave-0kls"
server_key: "49db151f335bd1d6ba02995bfdab477a"
server_key_iv: "e1ec529c254656161198d935897952e9"
server_key_version: "encryptionkey@0"
I20260811 01:38:25.774545 26314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:25.795432 26314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:25.799892 26314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:25.800201 26314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:25.803284 26314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:25.803406 26314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:25.803614 26314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:25.803695 26314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:38:25 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412305, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:25.828542 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:25.803793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:48643 (local address 127.17.132.62:40501)
0811 01:38:25.804747 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:25.804751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:25.805500 (+ 749us) server_negotiation.cc:407] Connection header received
0811 01:38:25.807625 (+ 2125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:25.807631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:25.807731 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:25.807863 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:25.810301 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.811386 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.814232 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.814949 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.815128 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:25.820258 (+ 5130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:25.820266 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:25.820272 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:25.820331 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:25.824342 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.825468 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.825475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.825484 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.825603 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.826289 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.826294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.826297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.826741 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:25.826909 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:25.827926 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 01:38:25.828176 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835,"thread_start_us":729,"threads_started":1}
I20260811 01:38:25.830308 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:25.804473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.1:48643)
0811 01:38:25.805338 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:25.805377 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:25.807333 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:25.808108 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:25.808117 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:25.808958 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:25.810032 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:25.810066 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.811576 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.811583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:25.814038 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:25.814060 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.815327 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.815338 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:25.815588 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:25.816545 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:25.816569 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:25.819957 (+ 3388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:25.824527 (+ 4570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:25.824542 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:25.824567 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:25.825286 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:25.825784 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:25.825790 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:25.825825 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:25.826134 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:25.826885 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:25.826893 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:25.827401 (+ 508us) client_negotiation.cc:769] Sending connection context
0811 01:38:25.827805 (+ 404us) client_negotiation.cc:240] Negotiation successful
0811 01:38:25.828474 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":380,"threads_started":1}
I20260811 01:38:25.854835 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:25.837657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:38961 (local address 127.17.132.62:40501)
0811 01:38:25.837920 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:25.837925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:25.838695 (+ 770us) server_negotiation.cc:407] Connection header received
0811 01:38:25.838934 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:25.838939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:25.839027 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:25.839147 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:25.840319 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.841736 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.843895 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.844857 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.845040 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:25.847557 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:25.847567 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:25.847574 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:25.847628 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:25.851350 (+ 3722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.852330 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.852336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.852340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.852478 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:25.852980 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:25.852989 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:25.852995 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:25.853491 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:25.853702 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:25.854201 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 01:38:25.854449 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:38:25.854938 26430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:25.837747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.1:38961)
0811 01:38:25.838576 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:25.838604 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:25.838774 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:25.839177 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:25.839182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:25.839714 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:25.840100 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:25.840111 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.841958 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.841969 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:25.843717 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:25.843732 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:25.845076 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:25.845081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:25.845268 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:25.846003 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:25.846025 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:25.847314 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:25.851535 (+ 4221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:25.851539 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:25.851541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:25.852189 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:25.852606 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:25.852614 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:25.852617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:25.852832 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:25.853660 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:25.853666 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:25.853916 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 01:38:25.854092 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 01:38:25.854475 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":392,"threads_started":1}
I20260811 01:38:25.858409 26314 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42391
I20260811 01:38:25.858414 26470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42391 every 8 connection(s)
I20260811 01:38:25.859823 26314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:25.861940 26471 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40501
I20260811 01:38:25.862187 26471 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:25.862839 26471 heartbeater.cc:511] Master 127.17.132.62:40501 requested a full tablet report, sending...
I20260811 01:38:25.864144 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 26314
I20260811 01:38:25.864372 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:25.864894 26225 ts_manager.cc:194] Registered new tserver with Master: c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391)
I20260811 01:38:25.865105 17936 external_mini_cluster.cc:1428] Setting key 63f13f351971fbfc9028b371d7816d50
I20260811 01:38:25.866701 26225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:48643
WARNING: no policy specified for oryx/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
I20260811 01:38:25.927161 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40501
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:26.286348 26477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:26.286654 26477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:26.286823 26477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:26.294494 26477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:26.294628 26477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:26.294811 26477 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:38:26.294929 26477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:26.305512 26477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:26.307013 26477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:26.308386 26477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:26.323383 26483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:26.323449 26486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:26.323408 26484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:26.324472 26477 server_base.cc:1034] running on GCE node
I20260811 01:38:26.325199 26477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:26.326324 26477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:26.327593 26477 hybrid_clock.cc:648] HybridClock initialized: now 1786412306327497 us; error 58 us; skew 500 ppm
I20260811 01:38:26.327991 26477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:26 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412306, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:26.335923 26477 init.cc:377] Logged in from keytab as oryx/127.17.132.2@KRBTEST.COM (short username oryx)
I20260811 01:38:26.337949 26477 webserver.cc:460] Webserver started at http://127.17.132.2:43563/ using document root <none> and password file <none>
I20260811 01:38:26.338819 26477 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:26.338917 26477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:26.339265 26477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:26.342681 26477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "638111a131b28e8f374358a1bfb90293"
server_key_iv: "6cee2dff12bc6d41a47b19c599539522"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.343549 26477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "638111a131b28e8f374358a1bfb90293"
server_key_iv: "6cee2dff12bc6d41a47b19c599539522"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.349231 26477 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:38:26.353024 26493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:26.354681 26477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:26.354882 26477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "638111a131b28e8f374358a1bfb90293"
server_key_iv: "6cee2dff12bc6d41a47b19c599539522"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.355185 26477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:26.412264 26477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:26.419446 26477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:26.419839 26477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:26.424572 26477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:26.424700 26477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:26.424881 26477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:26.424970 26477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:38:26 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412306, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:26.449316 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.424314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:50309 (local address 127.17.132.62:40501)
0811 01:38:26.424875 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:26.424884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:26.426426 (+ 1542us) server_negotiation.cc:407] Connection header received
0811 01:38:26.429936 (+ 3510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:26.429942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:26.430028 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:26.430164 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:26.432558 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.433739 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.435578 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.436297 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.436426 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:26.441154 (+ 4728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:26.441162 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:26.441168 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:26.441216 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:26.445175 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:26.446385 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:26.446393 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:26.446398 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:26.446576 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:26.447179 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:26.447184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:26.447188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:26.447565 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:26.447767 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:26.448661 (+ 894us) server_negotiation.cc:299] Negotiation successful
0811 01:38:26.448904 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":279,"threads_started":1}
I20260811 01:38:26.450567 26505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.425116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.2:50309)
0811 01:38:26.426190 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:26.426286 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:26.429486 (+ 3200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:26.430437 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:26.430445 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:26.431287 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:26.432259 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:26.432291 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.433943 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.433948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:26.435418 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:26.435430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.436543 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.436551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:26.436775 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:26.437491 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:26.437514 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:26.440830 (+ 3316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:26.445402 (+ 4572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:26.445413 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:26.445435 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:26.446231 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:26.446741 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:26.446751 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:26.446757 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:26.447036 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:26.447734 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:26.447742 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:26.448252 (+ 510us) client_negotiation.cc:769] Sending connection context
0811 01:38:26.448543 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 01:38:26.449123 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":422,"threads_started":1}
I20260811 01:38:26.474082 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.456690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:33173 (local address 127.17.132.62:40501)
0811 01:38:26.456867 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:26.456872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:26.457728 (+ 856us) server_negotiation.cc:407] Connection header received
0811 01:38:26.457954 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:26.457959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:26.458045 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:26.458139 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:26.459247 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.460430 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.462472 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.463142 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.463282 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:26.465860 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:26.465869 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:26.465877 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:26.465926 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:26.469499 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:26.471041 (+ 1542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:26.471049 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:26.471052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:26.471232 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:26.471752 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:26.471757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:26.471761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:26.472255 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:26.472416 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:26.473116 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 01:38:26.473462 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 01:38:26.474180 26548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.456930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.2:33173)
0811 01:38:26.457620 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:26.457643 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:26.457826 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:26.458172 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:26.458176 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:26.458691 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:26.459086 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:26.459108 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.460626 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.460635 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:26.462321 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:26.462342 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.463350 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.463358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:26.463624 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:26.464382 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:26.464412 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:26.465618 (+ 1206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:26.469895 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:26.469903 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:26.469911 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:26.470811 (+ 900us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:26.471395 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:26.471402 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:26.471407 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:26.471619 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:26.472492 (+ 873us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:26.472499 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:26.472740 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 01:38:26.472932 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 01:38:26.473409 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":375,"threads_started":1}
I20260811 01:38:26.487972 26477 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:41297
I20260811 01:38:26.487991 26636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:41297 every 8 connection(s)
I20260811 01:38:26.489423 26477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:26.490432 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 26477
I20260811 01:38:26.490664 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:26.491266 17936 external_mini_cluster.cc:1428] Setting key 49ab3b8b1b98a4a51d69728b959328b9
I20260811 01:38:26.492388 26637 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40501
I20260811 01:38:26.492669 26637 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:26.493530 26637 heartbeater.cc:511] Master 127.17.132.62:40501 requested a full tablet report, sending...
I20260811 01:38:26.495253 26225 ts_manager.cc:194] Registered new tserver with Master: ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297)
I20260811 01:38:26.496531 26225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:50309
WARNING: no policy specified for oryx/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
I20260811 01:38:26.551753 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40501
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:26.869537 26471 heartbeater.cc:503] Master 127.17.132.62:40501 was elected leader, sending a full tablet report...
W20260811 01:38:26.904973 26641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:26.905341 26641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:26.905510 26641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:26.913949 26641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:26.914103 26641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:26.914247 26641 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:38:26.914387 26641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:26.924660 26641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.132.62:40501
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:26.926095 26641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:26.927487 26641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:26.941895 26647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:26.941815 26648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:26.941859 26651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:26.943289 26641 server_base.cc:1034] running on GCE node
I20260811 01:38:26.944021 26641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:26.945011 26641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:26.946264 26641 hybrid_clock.cc:648] HybridClock initialized: now 1786412306946189 us; error 45 us; skew 500 ppm
I20260811 01:38:26.946583 26641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:26 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412306, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:26.949920 26641 init.cc:377] Logged in from keytab as oryx/127.17.132.3@KRBTEST.COM (short username oryx)
I20260811 01:38:26.951409 26641 webserver.cc:460] Webserver started at http://127.17.132.3:42145/ using document root <none> and password file <none>
I20260811 01:38:26.952165 26641 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:26.952265 26641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:26.952548 26641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:26.955655 26641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "78bb6ccba7f34328afaa7daa71916659"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "2e5346f7d0f01da2560db3bdb0b63265"
server_key_iv: "3ed4921b519001a6b222069c81ab0daa"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.956432 26641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "78bb6ccba7f34328afaa7daa71916659"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "2e5346f7d0f01da2560db3bdb0b63265"
server_key_iv: "3ed4921b519001a6b222069c81ab0daa"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.961977 26641 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:38:26.965530 26661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:26.966969 26641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:26.967108 26641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "78bb6ccba7f34328afaa7daa71916659"
format_stamp: "Formatted at 2026-08-11 01:38:26 on dist-test-slave-0kls"
server_key: "2e5346f7d0f01da2560db3bdb0b63265"
server_key_iv: "3ed4921b519001a6b222069c81ab0daa"
server_key_version: "encryptionkey@0"
I20260811 01:38:26.967298 26641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:26.983078 26641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:26.987215 26641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:26.987468 26641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:26.990309 26641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:26.990401 26641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:26.990595 26641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:26.990666 26641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:38:27 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412306, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:27.018464 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.991642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.3:51441)
0811 01:38:26.992526 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:26.992595 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:26.994639 (+ 2044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:26.995438 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:26.995450 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:26.996270 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:26.997225 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:26.997260 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.998854 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:26.998864 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:27.001271 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:27.001293 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.002318 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.002326 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:27.002564 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:27.003522 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:27.003563 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:27.007096 (+ 3533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:27.011748 (+ 4652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:27.011764 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:27.011784 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:27.012620 (+ 836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:27.013169 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:27.013184 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:27.013188 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:27.013487 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:27.014238 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:27.014253 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:27.014893 (+ 640us) client_negotiation.cc:769] Sending connection context
0811 01:38:27.015357 (+ 464us) client_negotiation.cc:240] Negotiation successful
0811 01:38:27.016116 (+ 759us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":372,"threads_started":1}
I20260811 01:38:27.018842 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:26.991027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:51441 (local address 127.17.132.62:40501)
0811 01:38:26.991538 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:26.991544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:26.992741 (+ 1197us) server_negotiation.cc:407] Connection header received
0811 01:38:26.994941 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:26.994949 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:26.995050 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:26.995181 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:26.997501 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:26.998675 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.001471 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.002056 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.002206 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:27.007396 (+ 5190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:27.007401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:27.007405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:27.007443 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:27.011555 (+ 4112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:27.012812 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:27.012818 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:27.012821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:27.012970 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:27.013649 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:27.013657 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:27.013660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:27.014042 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:27.014212 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:27.018024 (+ 3812us) server_negotiation.cc:299] Negotiation successful
0811 01:38:27.018367 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":253,"threads_started":1}
I20260811 01:38:27.042886 26753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:27.024973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.17.132.3:57307)
0811 01:38:27.025805 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:27.025831 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:27.026038 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:27.026466 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:27.026474 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:27.027275 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:27.027776 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:27.027794 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.028825 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.028833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:27.031158 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:27.031185 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.032130 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.032140 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:27.032421 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:27.033351 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:27.033370 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:27.034700 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:27.039487 (+ 4787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:27.039497 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:27.039502 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:27.040118 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:27.040802 (+ 684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:27.040806 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:27.040808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:27.040967 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:27.041829 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:27.041835 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:27.042078 (+ 243us) client_negotiation.cc:769] Sending connection context
0811 01:38:27.042209 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 01:38:27.042485 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":400,"threads_started":1}
I20260811 01:38:27.043234 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:27.025011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:57307 (local address 127.17.132.62:40501)
0811 01:38:27.025264 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:27.025273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:27.025955 (+ 682us) server_negotiation.cc:407] Connection header received
0811 01:38:27.026210 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:27.026217 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:27.026299 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:27.026384 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:27.027963 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.028679 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.031382 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.031888 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.032005 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:27.034957 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:27.034964 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:27.034969 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:27.035018 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:27.039273 (+ 4255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:27.040289 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:27.040298 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:27.040305 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:27.040518 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:27.041121 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:27.041129 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:27.041135 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:27.041644 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:27.041884 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:27.042407 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 01:38:27.042727 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:38:27.050367 26641 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:43703
I20260811 01:38:27.050407 26789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:43703 every 8 connection(s)
I20260811 01:38:27.051604 26641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:27.053936 26790 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40501
I20260811 01:38:27.054150 26790 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:27.054760 26790 heartbeater.cc:511] Master 127.17.132.62:40501 requested a full tablet report, sending...
I20260811 01:38:27.056077 26225 ts_manager.cc:194] Registered new tserver with Master: 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:27.056879 26225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:51441
I20260811 01:38:27.060453 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 26641
I20260811 01:38:27.060672 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:27.061102 17936 external_mini_cluster.cc:1428] Setting key 04796cddfada37887c2799979a9c184f
I20260811 01:38:27.064060 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:38:27 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412307, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:38:27 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:27 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:27.499280 26637 heartbeater.cc:503] Master 127.17.132.62:40501 was elected leader, sending a full tablet report...
I20260811 01:38:28.059330 26790 heartbeater.cc:503] Master 127.17.132.62:40501 was elected leader, sending a full tablet report...
W20260811 01:38:28.261133 26799 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.140s user 0.001s sys 0.019s
W20260811 01:38:28.262416 26670 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:27.115225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47638 (local address 127.17.132.62:40501)
0811 01:38:27.115453 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:27.115461 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:27.115664 (+ 203us) server_negotiation.cc:407] Connection header received
0811 01:38:27.115922 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:27.115926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:27.115993 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:27.116106 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:27.117494 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.118325 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.119612 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:27.120067 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:27.120211 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.262152 (+1141941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47638: BlockingRecv error: recv got EOF from 127.0.0.1:47638 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 01:38:28 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412307, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:28.280401 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.265913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.17.132.62:40501)
0811 01:38:28.266143 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.266151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.266394 (+ 243us) server_negotiation.cc:407] Connection header received
0811 01:38:28.266616 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.266625 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.266690 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.266805 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:28.268107 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.268828 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.270174 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.270758 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.270908 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.274906 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:28.274920 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:28.274924 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:28.274961 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:28.277477 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:28.278266 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:28.278272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:28.278275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:28.278410 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:28.278816 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:28.278821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:28.278824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:28.279195 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:28.279480 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.279817 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.280068 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:38:28.284885 26225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:28.292201 26225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:28.317742 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.308848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51832 (local address 127.17.132.2:41297)
0811 01:38:28.309889 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.309897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.309923 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:38:28.310023 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.310030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.310253 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.310448 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.311072 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.312270 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.315430 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316447 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.316623 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.316877 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.317190 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.317389 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":694,"threads_started":1}
I20260811 01:38:28.318152 26812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.305949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.0.0.1:48826)
0811 01:38:28.307013 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.307081 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.307304 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.308614 (+ 1310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.308623 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.308670 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.309256 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.309277 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.311629 (+ 2352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.311634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.314780 (+ 3146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.314796 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316817 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.316830 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.317034 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.317069 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.317143 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.317405 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":204,"thread_start_us":451,"threads_started":1}
I20260811 01:38:28.318185 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.307252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43703 (local address 127.0.0.1:55880)
0811 01:38:28.307916 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.307936 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.308053 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.309181 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.309189 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.309213 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.309664 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.309678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.311756 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.311761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.314661 (+ 2900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.314677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316845 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.316850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.317299 (+ 449us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.317342 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.317425 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.317564 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":484,"thread_start_us":707,"threads_started":1}
I20260811 01:38:28.318961 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.307810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.17.132.3:43703)
0811 01:38:28.308563 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.308573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.308618 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:38:28.308720 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.308728 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.308958 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.309901 (+ 943us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.310118 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.311548 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.314880 (+ 3332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316529 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.317064 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.317300 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.318453 (+ 1153us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.318666 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":454,"threads_started":1}
I20260811 01:38:28.319229 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.308282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:41297 (local address 127.0.0.1:51832)
0811 01:38:28.308827 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.308844 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.308960 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.310462 (+ 1502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.310466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.310493 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.310866 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.310877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.312421 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.312426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.315266 (+ 2840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.315277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316682 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.316689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.316927 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.316983 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.317133 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.318811 (+ 1678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":54,"thread_start_us":765,"threads_started":1}
I20260811 01:38:28.319648 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.306133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48826 (local address 127.17.132.1:42391)
0811 01:38:28.307897 (+ 1764us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.307907 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.307937 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:38:28.308040 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.308048 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.308327 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.309913 (+ 1586us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.310136 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.311486 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.314983 (+ 3497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.316530 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.317415 (+ 885us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.319117 (+ 1702us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.319205 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.319411 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1591,"thread_start_us":1842,"threads_started":1}
I20260811 01:38:28.323163 26393 tablet_service.cc:1467] Processing CreateTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 (DEFAULT_TABLE table=test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.323163 26716 tablet_service.cc:1467] Processing CreateTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 (DEFAULT_TABLE table=test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.323148 26557 tablet_service.cc:1467] Processing CreateTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 (DEFAULT_TABLE table=test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.324702 26557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ea17da5c35f488bad1052d2039d35a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.324733 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ea17da5c35f488bad1052d2039d35a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.324743 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ea17da5c35f488bad1052d2039d35a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.339480 26818 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Bootstrap starting.
I20260811 01:38:28.343156 26818 tablet_bootstrap.cc:654] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.344269 26818 log.cc:824] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:28.345711 26819 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Bootstrap starting.
I20260811 01:38:28.347797 26820 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Bootstrap starting.
I20260811 01:38:28.347935 26818 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: No bootstrap required, opened a new log
I20260811 01:38:28.348277 26818 ts_tablet_manager.cc:1397] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260811 01:38:28.351859 26820 tablet_bootstrap.cc:654] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.353297 26820 log.cc:824] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:28.355238 26819 tablet_bootstrap.cc:654] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.356267 26819 log.cc:824] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:28.356763 26820 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: No bootstrap required, opened a new log
I20260811 01:38:28.357056 26820 ts_tablet_manager.cc:1397] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260811 01:38:28.359272 26818 raft_consensus.cc:348] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.359969 26818 raft_consensus.cc:374] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.360082 26818 raft_consensus.cc:729] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.360140 26819 tablet_bootstrap.cc:492] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: No bootstrap required, opened a new log
I20260811 01:38:28.360492 26819 ts_tablet_manager.cc:1397] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260811 01:38:28.360806 26818 consensus_queue.cc:260] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.362704 26818 ts_tablet_manager.cc:1428] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent starting tablet: real 0.014s user 0.000s sys 0.013s
I20260811 01:38:28.366953 26820 raft_consensus.cc:348] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.367440 26820 raft_consensus.cc:374] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.367573 26820 raft_consensus.cc:729] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.368142 26820 consensus_queue.cc:260] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.369957 26820 ts_tablet_manager.cc:1428] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent starting tablet: real 0.013s user 0.009s sys 0.006s
I20260811 01:38:28.370496 26819 raft_consensus.cc:348] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.371016 26819 raft_consensus.cc:374] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.371168 26819 raft_consensus.cc:729] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.371871 26819 consensus_queue.cc:260] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.373811 26819 ts_tablet_manager.cc:1428] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
W20260811 01:38:28.493444 26638 tablet.cc:2369] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:28.554028 26826 raft_consensus.cc:482] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 01:38:28.554381 26791 tablet.cc:2369] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:28.554453 26826 raft_consensus.cc:504] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.556386 26826 leader_election.cc:288] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297)
I20260811 01:38:28.564306 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.557051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:33829 (local address 127.17.132.1:42391)
0811 01:38:28.557314 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.557320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.557547 (+ 227us) server_negotiation.cc:407] Connection header received
0811 01:38:28.557835 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.557843 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.557952 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.558054 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.558853 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.559865 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.562009 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.563151 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.563280 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.563337 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.563866 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.564020 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:38:28.564415 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.556698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.17.132.3:33829)
0811 01:38:28.557429 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.557450 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.557655 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.558175 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.558179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.558210 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.558701 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.558714 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.559996 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.560002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.561718 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.561732 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.563376 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.563384 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.563608 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.563714 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.563811 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.563967 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":1,"thread_start_us":314,"threads_started":1}
I20260811 01:38:28.564738 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.557859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40391 (local address 127.17.132.2:41297)
0811 01:38:28.558083 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.558089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.558369 (+ 280us) server_negotiation.cc:407] Connection header received
0811 01:38:28.558587 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.558592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.558697 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.558805 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.559425 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.560433 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.562678 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.563685 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.563858 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.563927 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.564332 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.564488 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:38:28.564851 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.557526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:41297 (local address 127.17.132.3:40391)
0811 01:38:28.558255 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.558270 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.558395 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.558843 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.558847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.558872 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.559255 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.559267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.560582 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.560586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.562469 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.562485 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.563940 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.563948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.564149 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.564183 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.564289 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.564441 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":1,"thread_start_us":401,"threads_started":1}
I20260811 01:38:28.565675 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ea17da5c35f488bad1052d2039d35a1" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" is_pre_election: true
I20260811 01:38:28.565855 26581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ea17da5c35f488bad1052d2039d35a1" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" is_pre_election: true
I20260811 01:38:28.566316 26414 raft_consensus.cc:2454] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 0.
I20260811 01:38:28.566396 26581 raft_consensus.cc:2454] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 0.
I20260811 01:38:28.567075 26664 leader_election.cc:302] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bb6ccba7f34328afaa7daa71916659, c6e6210e1dd54fa0989ae6e4a754c2be; no voters:
I20260811 01:38:28.567487 26826 raft_consensus.cc:2781] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:28.567649 26826 raft_consensus.cc:482] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:28.567767 26826 raft_consensus.cc:3037] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.570137 26826 raft_consensus.cc:504] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.570827 26826 leader_election.cc:288] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 election: Requested vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297)
I20260811 01:38:28.571393 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ea17da5c35f488bad1052d2039d35a1" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
I20260811 01:38:28.571516 26581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ea17da5c35f488bad1052d2039d35a1" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
I20260811 01:38:28.571671 26414 raft_consensus.cc:3037] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.571849 26581 raft_consensus.cc:3037] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.574326 26414 raft_consensus.cc:2454] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 1.
I20260811 01:38:28.574400 26581 raft_consensus.cc:2454] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 1.
I20260811 01:38:28.574980 26664 leader_election.cc:302] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bb6ccba7f34328afaa7daa71916659, c6e6210e1dd54fa0989ae6e4a754c2be; no voters:
I20260811 01:38:28.575371 26826 raft_consensus.cc:2781] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:28.575883 26826 raft_consensus.cc:686] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 1 LEADER]: Becoming Leader. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Running, Role: LEADER
I20260811 01:38:28.576424 26826 consensus_queue.cc:237] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } }
I20260811 01:38:28.581468 26225 catalog_manager.cc:5495] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3). New cstate: current_term: 1 leader_uuid: "78bb6ccba7f34328afaa7daa71916659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } health_report { overall_health: UNKNOWN } } }
W20260811 01:38:28.613545 26473 tablet.cc:2369] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:38:28.618078 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.612081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55890 (local address 127.17.132.3:43703)
0811 01:38:28.612322 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.612326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.612342 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:38:28.612433 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.612437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.612525 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.612718 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:28.613095 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.614211 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.615665 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.616095 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.616202 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.616744 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:28.617345 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:28.617471 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.617605 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.617702 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:38:28.627012 26581 raft_consensus.cc:1261] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Refusing update from remote peer 78bb6ccba7f34328afaa7daa71916659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:28.627012 26414 raft_consensus.cc:1261] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Refusing update from remote peer 78bb6ccba7f34328afaa7daa71916659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:28.628077 26826 consensus_queue.cc:1035] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:28.628407 26829 consensus_queue.cc:1035] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:28.645642 26833 mvcc.cc:205] Tried to move back new op lower bound from 7317144816125497344 to 7317144815933075456. Current Snapshot: MvccSnapshot[applied={T|T < 7317144816125497344}]
I20260811 01:38:28.663381 26225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:28.663718 26225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:28.668838 26225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Sending DeleteTablet for 3 replicas of tablet 1ea17da5c35f488bad1052d2039d35a1
I20260811 01:38:28.670277 26393 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:28 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:48826
I20260811 01:38:28.670459 26557 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:28 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51832
I20260811 01:38:28.670476 26716 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ea17da5c35f488bad1052d2039d35a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:28 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55880
I20260811 01:38:28.673553 26225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:28.674602 26225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:28.686146 26846 tablet_replica.cc:330] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: stopping tablet replica
I20260811 01:38:28.686750 26846 raft_consensus.cc:2229] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:28.688089 26392 tablet_service.cc:1467] Processing CreateTablet for tablet 662cace058174c49af8088e8d772ce9e (DEFAULT_TABLE table=test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.688269 26846 raft_consensus.cc:2258] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:28.688313 26845 tablet_replica.cc:330] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: stopping tablet replica
I20260811 01:38:28.688602 26716 tablet_service.cc:1467] Processing CreateTablet for tablet 662cace058174c49af8088e8d772ce9e (DEFAULT_TABLE table=test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.688935 26556 tablet_service.cc:1467] Processing CreateTablet for tablet 662cace058174c49af8088e8d772ce9e (DEFAULT_TABLE table=test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:28.689244 26845 raft_consensus.cc:2229] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:28.689358 26844 tablet_replica.cc:330] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: stopping tablet replica
I20260811 01:38:28.689628 26556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 662cace058174c49af8088e8d772ce9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.689850 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 662cace058174c49af8088e8d772ce9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.690156 26845 raft_consensus.cc:2258] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:28.691314 26846 ts_tablet_manager.cc:1905] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:28.692711 26845 ts_tablet_manager.cc:1905] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:28.699112 26846 ts_tablet_manager.cc:1918] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:28.699353 26846 log.cc:1196] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/1ea17da5c35f488bad1052d2039d35a1
I20260811 01:38:28.699370 26818 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Bootstrap starting.
I20260811 01:38:28.699990 26846 ts_tablet_manager.cc:1939] T 1ea17da5c35f488bad1052d2039d35a1 P 78bb6ccba7f34328afaa7daa71916659: Deleting consensus metadata
I20260811 01:38:28.701130 26845 ts_tablet_manager.cc:1918] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:28.701421 26845 log.cc:1196] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/1ea17da5c35f488bad1052d2039d35a1
I20260811 01:38:28.702163 26845 ts_tablet_manager.cc:1939] T 1ea17da5c35f488bad1052d2039d35a1 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting consensus metadata
I20260811 01:38:28.701447 26818 tablet_bootstrap.cc:654] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.702196 26209 catalog_manager.cc:4841] TS 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703): tablet 1ea17da5c35f488bad1052d2039d35a1 (table test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]) successfully deleted
I20260811 01:38:28.704316 26819 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Bootstrap starting.
I20260811 01:38:28.704386 26209 catalog_manager.cc:4841] TS ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297): tablet 1ea17da5c35f488bad1052d2039d35a1 (table test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]) successfully deleted
I20260811 01:38:28.705246 26392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 662cace058174c49af8088e8d772ce9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.705417 26818 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: No bootstrap required, opened a new log
I20260811 01:38:28.705585 26818 ts_tablet_manager.cc:1397] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260811 01:38:28.706425 26819 tablet_bootstrap.cc:654] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.706457 26818 raft_consensus.cc:348] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.706717 26818 raft_consensus.cc:374] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.706820 26818 raft_consensus.cc:729] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.707114 26818 consensus_queue.cc:260] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.707715 26818 ts_tablet_manager.cc:1428] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 01:38:28.713066 26844 raft_consensus.cc:2229] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:28.713217 26820 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Bootstrap starting.
I20260811 01:38:28.714582 26844 raft_consensus.cc:2258] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:28.716598 26820 tablet_bootstrap.cc:654] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.717329 26844 ts_tablet_manager.cc:1905] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:28.725334 26844 ts_tablet_manager.cc:1918] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:28.725646 26844 log.cc:1196] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/1ea17da5c35f488bad1052d2039d35a1
I20260811 01:38:28.726363 26844 ts_tablet_manager.cc:1939] T 1ea17da5c35f488bad1052d2039d35a1 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting consensus metadata
I20260811 01:38:28.728577 26209 catalog_manager.cc:4841] TS c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391): tablet 1ea17da5c35f488bad1052d2039d35a1 (table test-table [id=d5f421d2cb1a4c0f88f930ee3aecf6f0]) successfully deleted
I20260811 01:38:28.730330 26820 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: No bootstrap required, opened a new log
I20260811 01:38:28.730526 26820 ts_tablet_manager.cc:1397] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.006s
I20260811 01:38:28.730836 26819 tablet_bootstrap.cc:492] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: No bootstrap required, opened a new log
I20260811 01:38:28.731019 26819 ts_tablet_manager.cc:1397] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.018s
I20260811 01:38:28.731359 26820 raft_consensus.cc:348] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.731582 26820 raft_consensus.cc:374] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.731691 26820 raft_consensus.cc:729] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.732000 26820 consensus_queue.cc:260] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.731978 26819 raft_consensus.cc:348] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.732239 26819 raft_consensus.cc:374] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.732338 26819 raft_consensus.cc:729] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.732627 26819 consensus_queue.cc:260] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.733614 26819 ts_tablet_manager.cc:1428] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260811 01:38:28.733738 26820 ts_tablet_manager.cc:1428] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:28.799705 26825 raft_consensus.cc:482] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:28.800009 26825 raft_consensus.cc:504] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.801682 26825 leader_election.cc:288] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:28.810443 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.803061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:46491 (local address 127.17.132.3:43703)
0811 01:38:28.803267 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.803273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.803768 (+ 495us) server_negotiation.cc:407] Connection header received
0811 01:38:28.803990 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.803997 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.804080 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.804183 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.804804 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.806009 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.808308 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.809155 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.809381 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.809465 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.809910 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.810088 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:38:28.810475 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.802920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43703 (local address 127.17.132.1:46491)
0811 01:38:28.803649 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.803667 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.803811 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.804224 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.804228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.804256 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.804624 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.804637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.806153 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.806158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.808112 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.808122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.809393 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.809399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.809632 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.809729 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.809860 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.810031 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":40,"thread_start_us":337,"threads_started":1}
I20260811 01:38:28.810906 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.802237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:46779 (local address 127.17.132.2:41297)
0811 01:38:28.802447 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.802454 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.802751 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:38:28.803014 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.803020 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.803107 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.803181 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:28.804086 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.805137 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.807901 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.809230 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.809423 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.809502 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.810101 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.810264 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:38:28.811566 26850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.802042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:41297 (local address 127.17.132.1:46779)
0811 01:38:28.802612 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.802629 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.802819 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.803447 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.803452 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.803479 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:28.803897 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.803909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.805286 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.805291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.807684 (+ 2393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.807702 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.809645 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.809651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.809912 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.809943 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.810985 (+ 1042us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.811148 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":20,"spinlock_wait_cycles":11520,"thread_start_us":417,"threads_started":1}
I20260811 01:38:28.811568 26737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "662cace058174c49af8088e8d772ce9e" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659" is_pre_election: true
I20260811 01:38:28.812167 26737 raft_consensus.cc:2454] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 0.
I20260811 01:38:28.812390 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "662cace058174c49af8088e8d772ce9e" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" is_pre_election: true
I20260811 01:38:28.812764 26578 raft_consensus.cc:2454] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 0.
I20260811 01:38:28.812994 26337 leader_election.cc:302] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bb6ccba7f34328afaa7daa71916659, c6e6210e1dd54fa0989ae6e4a754c2be; no voters:
I20260811 01:38:28.813457 26825 raft_consensus.cc:2781] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:28.813609 26825 raft_consensus.cc:482] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:28.813740 26825 raft_consensus.cc:3037] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.816075 26825 raft_consensus.cc:504] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.816917 26825 leader_election.cc:288] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 election: Requested vote from peers ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:28.817520 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "662cace058174c49af8088e8d772ce9e" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
I20260811 01:38:28.817654 26737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "662cace058174c49af8088e8d772ce9e" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659"
I20260811 01:38:28.817821 26578 raft_consensus.cc:3037] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.817950 26737 raft_consensus.cc:3037] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.820791 26578 raft_consensus.cc:2454] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 1.
I20260811 01:38:28.821491 26337 leader_election.cc:302] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6210e1dd54fa0989ae6e4a754c2be, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:28.821573 26737 raft_consensus.cc:2454] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 1.
I20260811 01:38:28.821892 26825 raft_consensus.cc:2781] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:28.830543 26825 raft_consensus.cc:686] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 LEADER]: Becoming Leader. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Running, Role: LEADER
I20260811 01:38:28.831028 26825 consensus_queue.cc:237] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.835150 26224 catalog_manager.cc:5495] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1). New cstate: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:38:28 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412305, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.62@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:28.898820 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.872658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.17.132.62:40501)
0811 01:38:28.883344 (+ 10686us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:28.883348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:28.883367 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:38:28.883411 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:28.883414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:28.883466 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:28.883553 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:28.885250 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.886119 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.887986 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.888395 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.888488 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.892640 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:28.892646 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:28.892649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:28.892680 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:28.895565 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:28.896300 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:28.896307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:28.896313 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:28.896446 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:28.896819 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:28.896825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:28.896828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:28.897382 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:28.897567 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:28.898093 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 01:38:28.898373 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":10581,"thread_start_us":10425,"threads_started":1}
I20260811 01:38:28.898934 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:28.872641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40501 (local address 127.0.0.1:47654)
0811 01:38:28.882515 (+ 9874us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:28.882548 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:28.882772 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:28.883681 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:28.883686 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:28.884677 (+ 991us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:28.885024 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.885038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.886294 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.886300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.887837 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:28.887853 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:28.888614 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:28.888622 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:28.888824 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:28.889584 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:28.889615 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:28.892417 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:28.895713 (+ 3296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:28.895729 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:28.895738 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:28.896176 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:28.896558 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:28.896564 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:28.896567 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:28.896710 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:28.897540 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:28.897549 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:28.897748 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 01:38:28.898013 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 01:38:28.898494 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9598,"mutex_wait_us":192,"thread_start_us":9353,"threads_started":1}
I20260811 01:38:28.904415 26224 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47654:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:38:28.905490 26224 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:28.912930 26556 tablet_service.cc:1467] Processing CreateTablet for tablet e9585a7b405442a493d7a5ff0d6855d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=373aec75e86a4043b5d6225cdfe235f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:38:28.912905 26392 tablet_service.cc:1467] Processing CreateTablet for tablet e9585a7b405442a493d7a5ff0d6855d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=373aec75e86a4043b5d6225cdfe235f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:38:28.913455 26556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9585a7b405442a493d7a5ff0d6855d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.913456 26392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9585a7b405442a493d7a5ff0d6855d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.918798 26818 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: Bootstrap starting.
I20260811 01:38:28.919535 26716 tablet_service.cc:1467] Processing CreateTablet for tablet e9585a7b405442a493d7a5ff0d6855d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=373aec75e86a4043b5d6225cdfe235f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:38:28.920171 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9585a7b405442a493d7a5ff0d6855d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:28.920624 26818 tablet_bootstrap.cc:654] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.921032 26820 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: Bootstrap starting.
I20260811 01:38:28.922813 26820 tablet_bootstrap.cc:654] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.931993 26819 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: Bootstrap starting.
I20260811 01:38:28.932044 26820 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: No bootstrap required, opened a new log
I20260811 01:38:28.932222 26820 ts_tablet_manager.cc:1397] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.002s
I20260811 01:38:28.933064 26820 raft_consensus.cc:348] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.933346 26820 raft_consensus.cc:374] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.933436 26820 raft_consensus.cc:729] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.933475 26818 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: No bootstrap required, opened a new log
I20260811 01:38:28.933749 26818 ts_tablet_manager.cc:1397] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.005s
I20260811 01:38:28.934020 26819 tablet_bootstrap.cc:654] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:28.934787 26818 raft_consensus.cc:348] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.934934 26820 consensus_queue.cc:260] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.935161 26818 raft_consensus.cc:374] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.935433 26818 raft_consensus.cc:729] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.935473 26825 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:28.935817 26825 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:28.935990 26818 consensus_queue.cc:260] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.936730 26824 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:28.937191 26824 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:28.938721 26818 ts_tablet_manager.cc:1428] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 01:38:28.940797 26820 ts_tablet_manager.cc:1428] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260811 01:38:28.940970 26819 tablet_bootstrap.cc:492] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: No bootstrap required, opened a new log
I20260811 01:38:28.941222 26819 ts_tablet_manager.cc:1397] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260811 01:38:28.942632 26819 raft_consensus.cc:348] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.942873 26819 raft_consensus.cc:374] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:28.942981 26819 raft_consensus.cc:729] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Initialized, Role: FOLLOWER
I20260811 01:38:28.943270 26819 consensus_queue.cc:260] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.943966 26819 ts_tablet_manager.cc:1428] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:28.943766 26829 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:28.944159 26829 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:28.973067 26825 raft_consensus.cc:482] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:28.973331 26825 raft_consensus.cc:504] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.974153 26825 leader_election.cc:288] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:28.974835 26737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9585a7b405442a493d7a5ff0d6855d8" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659" is_pre_election: true
I20260811 01:38:28.974864 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9585a7b405442a493d7a5ff0d6855d8" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" is_pre_election: true
I20260811 01:38:28.975126 26737 raft_consensus.cc:2454] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 0.
I20260811 01:38:28.975190 26578 raft_consensus.cc:2454] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 0.
I20260811 01:38:28.975756 26337 leader_election.cc:302] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6210e1dd54fa0989ae6e4a754c2be, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:28.976081 26825 raft_consensus.cc:2781] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:28.976199 26825 raft_consensus.cc:482] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:28.976342 26825 raft_consensus.cc:3037] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.978808 26825 raft_consensus.cc:504] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.979489 26825 leader_election.cc:288] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 election: Requested vote from peers ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:28.980028 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9585a7b405442a493d7a5ff0d6855d8" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
I20260811 01:38:28.980122 26737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9585a7b405442a493d7a5ff0d6855d8" candidate_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659"
I20260811 01:38:28.980304 26578 raft_consensus.cc:3037] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.980382 26737 raft_consensus.cc:3037] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:28.982487 26578 raft_consensus.cc:2454] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 1.
I20260811 01:38:28.982936 26337 leader_election.cc:302] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6210e1dd54fa0989ae6e4a754c2be, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:28.983222 26825 raft_consensus.cc:2781] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:28.983431 26825 raft_consensus.cc:686] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 LEADER]: Becoming Leader. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Running, Role: LEADER
I20260811 01:38:28.983693 26737 raft_consensus.cc:2454] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6210e1dd54fa0989ae6e4a754c2be in term 1.
I20260811 01:38:28.983698 26825 consensus_queue.cc:237] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:28.985549 26853 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: TxnStatusTablet state changed. Reason: New leader c6e6210e1dd54fa0989ae6e4a754c2be. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:28.986047 26853 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:38:28.986843 26868 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:38:28.987108 26868 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:38:28.988250 26222 catalog_manager.cc:5495] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1). New cstate: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } health_report { overall_health: UNKNOWN } } }
I20260811 01:38:29.017269 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.009803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.17.132.1:42391)
0811 01:38:29.009989 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.009995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.010017 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:38:29.010323 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.010329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.010434 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.010589 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.011102 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.012343 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.014388 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.015045 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.015200 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.015748 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.016478 (+ 730us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.016650 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.016820 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.016908 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:38:29.017297 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.009635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.0.0.1:48830)
0811 01:38:29.009919 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.009939 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.010086 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.010649 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.010655 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.010684 (+ 29us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:38:29.010925 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.010939 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.012513 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.012519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.014232 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.014247 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.015228 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.015234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.015450 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.015527 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.016631 (+ 1104us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.016667 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:38:29.016783 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:38:29.016950 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:38:29.022886 26578 raft_consensus.cc:1261] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Refusing update from remote peer c6e6210e1dd54fa0989ae6e4a754c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.023150 26737 raft_consensus.cc:1261] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Refusing update from remote peer c6e6210e1dd54fa0989ae6e4a754c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.023720 26853 consensus_queue.cc:1035] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.024981 26853 consensus_queue.cc:1035] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.038673 26829 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: TxnStatusTablet state changed. Reason: New leader c6e6210e1dd54fa0989ae6e4a754c2be. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.039217 26829 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:29.042827 26824 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: TxnStatusTablet state changed. Reason: New leader c6e6210e1dd54fa0989ae6e4a754c2be. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.043166 26824 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:29.043689 26853 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.043941 26853 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:38:29.049228 26829 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.049541 26829 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P 78bb6ccba7f34328afaa7daa71916659: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:29.056066 26825 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.056366 26825 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P c6e6210e1dd54fa0989ae6e4a754c2be: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:38:29.058235 26824 tablet_replica.cc:439] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } } }
I20260811 01:38:29.058491 26824 tablet_replica.cc:442] T e9585a7b405442a493d7a5ff0d6855d8 P ef76c98e9c3f4d07b4da710d29a17d2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:38:29.065742 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.058583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.17.132.1:42391)
0811 01:38:29.058775 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.058782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.058826 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:38:29.059107 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.059112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.059204 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.059294 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.059939 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.061075 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.062939 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.063671 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.063825 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.064313 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.064445 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.064536 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.065360 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.065442 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:38:29.111014 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.091899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:52943 (local address 127.17.132.1:42391)
0811 01:38:29.092124 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.092132 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.103560 (+ 11428us) server_negotiation.cc:407] Connection header received
0811 01:38:29.103804 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.103811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.103910 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.104046 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.104796 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.106039 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.108326 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.109095 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.109263 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.109896 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.110070 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.110141 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.110381 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.110540 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:38:29.111127 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.092264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.17.132.1:52943)
0811 01:38:29.103358 (+ 11094us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.103392 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.103622 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.104091 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.104097 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.104115 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:38:29.104585 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.104601 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.106214 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.106220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.108139 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.108158 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.109352 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.109359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.109548 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.109632 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.110219 (+ 587us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.110228 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:38:29.110319 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:38:29.110594 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10849,"mutex_wait_us":80,"thread_start_us":10658,"threads_started":1}
I20260811 01:38:29.124852 26578 raft_consensus.cc:1261] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Refusing update from remote peer c6e6210e1dd54fa0989ae6e4a754c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.124895 26737 raft_consensus.cc:1261] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Refusing update from remote peer c6e6210e1dd54fa0989ae6e4a754c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.125716 26825 consensus_queue.cc:1035] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.126168 26853 consensus_queue.cc:1035] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.141578 26835 mvcc.cc:205] Tried to move back new op lower bound from 7317144818169077760 to 7317144816976076800. Current Snapshot: MvccSnapshot[applied={T|T < 7317144818169077760}]
I20260811 01:38:29.148006 26836 mvcc.cc:205] Tried to move back new op lower bound from 7317144818169077760 to 7317144816976076800. Current Snapshot: MvccSnapshot[applied={T|T < 7317144818169077760}]
I20260811 01:38:29.246527 26222 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:29.246800 26222 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:29.249963 26222 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Sending DeleteTablet for 3 replicas of tablet 662cace058174c49af8088e8d772ce9e
I20260811 01:38:29.250721 26393 tablet_service.cc:1514] Processing DeleteTablet for tablet 662cace058174c49af8088e8d772ce9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:48826
I20260811 01:38:29.250905 26716 tablet_service.cc:1514] Processing DeleteTablet for tablet 662cace058174c49af8088e8d772ce9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55880
I20260811 01:38:29.250934 26556 tablet_service.cc:1514] Processing DeleteTablet for tablet 662cace058174c49af8088e8d772ce9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51832
I20260811 01:38:29.262106 26886 tablet_replica.cc:330] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: stopping tablet replica
I20260811 01:38:29.262382 26886 raft_consensus.cc:2229] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:29.262671 26886 raft_consensus.cc:2258] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.264024 26886 ts_tablet_manager.cc:1905] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.272692 26886 ts_tablet_manager.cc:1918] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:29.272938 26886 log.cc:1196] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/662cace058174c49af8088e8d772ce9e
I20260811 01:38:29.273559 26886 ts_tablet_manager.cc:1939] T 662cace058174c49af8088e8d772ce9e P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting consensus metadata
I20260811 01:38:29.275146 26209 catalog_manager.cc:4841] TS ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297): tablet 662cace058174c49af8088e8d772ce9e (table test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]) successfully deleted
I20260811 01:38:29.275267 26885 tablet_replica.cc:330] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: stopping tablet replica
I20260811 01:38:29.277990 26885 raft_consensus.cc:2229] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:29.278410 26885 raft_consensus.cc:2258] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.279325 26884 tablet_replica.cc:330] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: stopping tablet replica
I20260811 01:38:29.279579 26884 raft_consensus.cc:2229] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:29.280365 26884 raft_consensus.cc:2258] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.280876 26885 ts_tablet_manager.cc:1905] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.281651 26884 ts_tablet_manager.cc:1905] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.288468 26885 ts_tablet_manager.cc:1918] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:29.288758 26885 log.cc:1196] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/662cace058174c49af8088e8d772ce9e
I20260811 01:38:29.289117 26884 ts_tablet_manager.cc:1918] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:29.289341 26885 ts_tablet_manager.cc:1939] T 662cace058174c49af8088e8d772ce9e P 78bb6ccba7f34328afaa7daa71916659: Deleting consensus metadata
I20260811 01:38:29.289346 26884 log.cc:1196] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/662cace058174c49af8088e8d772ce9e
I20260811 01:38:29.289915 26884 ts_tablet_manager.cc:1939] T 662cace058174c49af8088e8d772ce9e P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting consensus metadata
I20260811 01:38:29.290830 26209 catalog_manager.cc:4841] TS 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703): tablet 662cace058174c49af8088e8d772ce9e (table test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]) successfully deleted
I20260811 01:38:29.291260 26209 catalog_manager.cc:4841] TS c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391): tablet 662cace058174c49af8088e8d772ce9e (table test-table [id=7a1cbe42e4534343952c283d1bd5a1c2]) successfully deleted
Aug 11 01:38:29 dist-test-slave-0kls krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:38:29 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:29 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:29.346005 26860 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:29.333128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47666 (local address 127.17.132.62:40501)
0811 01:38:29.333420 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.333430 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.333963 (+ 533us) server_negotiation.cc:407] Connection header received
0811 01:38:29.334217 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.334224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.334315 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.334440 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:29.336073 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.337294 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.338853 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.339536 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.339706 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.345702 (+ 5996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47666: BlockingRecv error: recv got EOF from 127.0.0.1:47666 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 11 01:38:29 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM
I20260811 01:38:29.365869 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.349017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47678 (local address 127.17.132.62:40501)
0811 01:38:29.349241 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.349247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.349506 (+ 259us) server_negotiation.cc:407] Connection header received
0811 01:38:29.349742 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.349746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.349852 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.349944 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:29.351660 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.352567 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.354528 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.354995 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.355099 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.360075 (+ 4976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:29.360080 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:29.360084 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:29.360129 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:29.363024 (+ 2895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:29.363741 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:29.363748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:29.363752 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:29.363897 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:29.364299 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:29.364305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:29.364310 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:29.364587 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:29.364894 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.365182 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.365431 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 01:38:29.369815 26222 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:29.370604 26222 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:29.377912 26393 tablet_service.cc:1467] Processing CreateTablet for tablet f654d9d3e7554a6bbb22830388b8c975 (DEFAULT_TABLE table=test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.378170 26556 tablet_service.cc:1467] Processing CreateTablet for tablet f654d9d3e7554a6bbb22830388b8c975 (DEFAULT_TABLE table=test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.378459 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f654d9d3e7554a6bbb22830388b8c975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.378598 26556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f654d9d3e7554a6bbb22830388b8c975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.382354 26716 tablet_service.cc:1467] Processing CreateTablet for tablet f654d9d3e7554a6bbb22830388b8c975 (DEFAULT_TABLE table=test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.382828 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f654d9d3e7554a6bbb22830388b8c975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.385250 26818 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Bootstrap starting.
I20260811 01:38:29.385528 26820 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Bootstrap starting.
I20260811 01:38:29.387063 26818 tablet_bootstrap.cc:654] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.387269 26820 tablet_bootstrap.cc:654] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.388710 26819 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Bootstrap starting.
I20260811 01:38:29.390389 26819 tablet_bootstrap.cc:654] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.397055 26819 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: No bootstrap required, opened a new log
I20260811 01:38:29.397253 26820 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: No bootstrap required, opened a new log
I20260811 01:38:29.397238 26819 ts_tablet_manager.cc:1397] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 01:38:29.397410 26820 ts_tablet_manager.cc:1397] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260811 01:38:29.398139 26819 raft_consensus.cc:348] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.398433 26819 raft_consensus.cc:374] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.398303 26820 raft_consensus.cc:348] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.398533 26819 raft_consensus.cc:729] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.398625 26820 raft_consensus.cc:374] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.398742 26820 raft_consensus.cc:729] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.398806 26819 consensus_queue.cc:260] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.398972 26820 consensus_queue.cc:260] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.399502 26819 ts_tablet_manager.cc:1428] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:38:29.400882 26818 tablet_bootstrap.cc:492] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: No bootstrap required, opened a new log
I20260811 01:38:29.401044 26820 ts_tablet_manager.cc:1428] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 01:38:29.401074 26818 ts_tablet_manager.cc:1397] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.004s
I20260811 01:38:29.402001 26818 raft_consensus.cc:348] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.402257 26818 raft_consensus.cc:374] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.402360 26818 raft_consensus.cc:729] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.402622 26818 consensus_queue.cc:260] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.403750 26818 ts_tablet_manager.cc:1428] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:38:29.499338 26824 raft_consensus.cc:482] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:29.499595 26824 raft_consensus.cc:504] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.501565 26824 leader_election.cc:288] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:29.512060 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.502441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:49417 (local address 127.17.132.1:42391)
0811 01:38:29.502652 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.502659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.503245 (+ 586us) server_negotiation.cc:407] Connection header received
0811 01:38:29.503524 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.503530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.503607 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.503682 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:29.504669 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.505837 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.508408 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.509772 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.510248 (+ 476us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.510330 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.511541 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.511743 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:38:29.513360 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.501810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.17.132.2:49417)
0811 01:38:29.503127 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.503148 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.503361 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.503901 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.503906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.503933 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:29.504452 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.504470 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.506052 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.506058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.508200 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.508217 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.511062 (+ 2845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.511068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.511311 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.511355 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:38:29.512786 (+ 1431us) client_negotiation.cc:240] Negotiation successful
0811 01:38:29.512959 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"thread_start_us":1016,"threads_started":1}
I20260811 01:38:29.515295 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f654d9d3e7554a6bbb22830388b8c975" candidate_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" is_pre_election: true
I20260811 01:38:29.515592 26414 raft_consensus.cc:2454] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef76c98e9c3f4d07b4da710d29a17d2c in term 0.
I20260811 01:38:29.516323 26497 leader_election.cc:302] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6210e1dd54fa0989ae6e4a754c2be, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:29.516871 26824 raft_consensus.cc:2781] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:29.517004 26824 raft_consensus.cc:482] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:29.517112 26824 raft_consensus.cc:3037] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.520798 26824 raft_consensus.cc:504] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.521602 26824 leader_election.cc:288] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [CANDIDATE]: Term 1 election: Requested vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703)
I20260811 01:38:29.522527 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f654d9d3e7554a6bbb22830388b8c975" candidate_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
I20260811 01:38:29.522854 26414 raft_consensus.cc:3037] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.526257 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.503271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43703 (local address 127.17.132.2:48645)
0811 01:38:29.513860 (+ 10589us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.513881 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.513999 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.519670 (+ 5671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.519676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.519708 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:38:29.519915 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.519933 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.521538 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.521543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.523581 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.523599 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.525407 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.525414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.525606 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.525642 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:38:29.525739 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:38:29.525919 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10444,"thread_start_us":11133,"threads_started":1}
I20260811 01:38:29.526263 26414 raft_consensus.cc:2454] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef76c98e9c3f4d07b4da710d29a17d2c in term 1.
I20260811 01:38:29.526996 26905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.503644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:48645 (local address 127.17.132.3:43703)
0811 01:38:29.519120 (+ 15476us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.519128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.519153 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:38:29.519243 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.519252 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.519341 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.519468 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:38:29.520112 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.521315 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.523799 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.525036 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.525205 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.525279 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.526511 (+ 1232us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.526689 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15329,"thread_start_us":15214,"threads_started":1}
I20260811 01:38:29.526966 26497 leader_election.cc:302] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6210e1dd54fa0989ae6e4a754c2be, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:29.527390 26824 raft_consensus.cc:2781] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:29.527711 26734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f654d9d3e7554a6bbb22830388b8c975" candidate_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659" is_pre_election: true
I20260811 01:38:29.527913 26824 raft_consensus.cc:686] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 LEADER]: Becoming Leader. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Running, Role: LEADER
I20260811 01:38:29.528020 26734 raft_consensus.cc:2454] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef76c98e9c3f4d07b4da710d29a17d2c in term 0.
I20260811 01:38:29.528234 26735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f654d9d3e7554a6bbb22830388b8c975" candidate_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78bb6ccba7f34328afaa7daa71916659"
I20260811 01:38:29.528441 26735 raft_consensus.cc:3037] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.528841 26824 consensus_queue.cc:237] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.531692 26735 raft_consensus.cc:2454] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef76c98e9c3f4d07b4da710d29a17d2c in term 1.
I20260811 01:38:29.534173 26222 catalog_manager.cc:5495] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2). New cstate: current_term: 1 leader_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } health_report { overall_health: UNKNOWN } } }
I20260811 01:38:29.555444 26911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.548018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.17.132.2:41297)
0811 01:38:29.548669 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.548675 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.548709 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:38:29.548843 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.548848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.548946 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.549123 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.549565 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.550782 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.552450 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.553123 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.553264 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.553848 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.554671 (+ 823us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.554834 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.554955 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.555047 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":359,"threads_started":1}
I20260811 01:38:29.559944 26735 raft_consensus.cc:1261] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Refusing update from remote peer ef76c98e9c3f4d07b4da710d29a17d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.560075 26414 raft_consensus.cc:1261] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Refusing update from remote peer ef76c98e9c3f4d07b4da710d29a17d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.560853 26906 consensus_queue.cc:1035] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.561281 26824 consensus_queue.cc:1035] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.588527 26225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:29.588871 26225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:29.592975 26225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Sending DeleteTablet for 3 replicas of tablet f654d9d3e7554a6bbb22830388b8c975
I20260811 01:38:29.594273 26716 tablet_service.cc:1514] Processing DeleteTablet for tablet f654d9d3e7554a6bbb22830388b8c975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55880
I20260811 01:38:29.594291 26556 tablet_service.cc:1514] Processing DeleteTablet for tablet f654d9d3e7554a6bbb22830388b8c975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51832
I20260811 01:38:29.594669 26886 tablet_replica.cc:330] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: stopping tablet replica
I20260811 01:38:29.594678 26885 tablet_replica.cc:330] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: stopping tablet replica
I20260811 01:38:29.594899 26885 raft_consensus.cc:2229] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:29.594908 26886 raft_consensus.cc:2229] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:29.595172 26885 raft_consensus.cc:2258] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.595489 26886 raft_consensus.cc:2258] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.595963 26393 tablet_service.cc:1514] Processing DeleteTablet for tablet f654d9d3e7554a6bbb22830388b8c975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:29 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:48826
I20260811 01:38:29.596284 26884 tablet_replica.cc:330] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: stopping tablet replica
I20260811 01:38:29.596495 26884 raft_consensus.cc:2229] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:29.596740 26884 raft_consensus.cc:2258] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:29.596797 26886 ts_tablet_manager.cc:1905] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.598815 26884 ts_tablet_manager.cc:1905] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.602636 26885 ts_tablet_manager.cc:1905] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:29.604547 26886 ts_tablet_manager.cc:1918] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:29.604735 26886 log.cc:1196] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/f654d9d3e7554a6bbb22830388b8c975
I20260811 01:38:29.605238 26886 ts_tablet_manager.cc:1939] T f654d9d3e7554a6bbb22830388b8c975 P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting consensus metadata
I20260811 01:38:29.606696 26209 catalog_manager.cc:4841] TS ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297): tablet f654d9d3e7554a6bbb22830388b8c975 (table test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]) successfully deleted
I20260811 01:38:29.608942 26225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:38:29.609860 26225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:38:29.619436 26716 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9cb8c8090c40b08a94784136e879fd (DEFAULT_TABLE table=test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.619472 26556 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9cb8c8090c40b08a94784136e879fd (DEFAULT_TABLE table=test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.620000 26556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9cb8c8090c40b08a94784136e879fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.620029 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9cb8c8090c40b08a94784136e879fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.621029 26885 ts_tablet_manager.cc:1918] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:29.621213 26885 log.cc:1196] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/f654d9d3e7554a6bbb22830388b8c975
I20260811 01:38:29.621692 26885 ts_tablet_manager.cc:1939] T f654d9d3e7554a6bbb22830388b8c975 P 78bb6ccba7f34328afaa7daa71916659: Deleting consensus metadata
I20260811 01:38:29.623113 26209 catalog_manager.cc:4841] TS 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703): tablet f654d9d3e7554a6bbb22830388b8c975 (table test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]) successfully deleted
I20260811 01:38:29.623554 26393 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9cb8c8090c40b08a94784136e879fd (DEFAULT_TABLE table=test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:38:29.624311 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9cb8c8090c40b08a94784136e879fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:29.627985 26819 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Bootstrap starting.
I20260811 01:38:29.629760 26819 tablet_bootstrap.cc:654] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.630260 26818 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Bootstrap starting.
I20260811 01:38:29.632438 26818 tablet_bootstrap.cc:654] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.632540 26820 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Bootstrap starting.
I20260811 01:38:29.634320 26820 tablet_bootstrap.cc:654] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:29.644341 26819 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: No bootstrap required, opened a new log
I20260811 01:38:29.644570 26819 ts_tablet_manager.cc:1397] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.009s
I20260811 01:38:29.645449 26819 raft_consensus.cc:348] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.645838 26819 raft_consensus.cc:374] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.645944 26819 raft_consensus.cc:729] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.646291 26819 consensus_queue.cc:260] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.646464 26884 ts_tablet_manager.cc:1918] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:38:29.646713 26884 log.cc:1196] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/f654d9d3e7554a6bbb22830388b8c975
I20260811 01:38:29.647213 26884 ts_tablet_manager.cc:1939] T f654d9d3e7554a6bbb22830388b8c975 P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting consensus metadata
I20260811 01:38:29.647389 26820 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: No bootstrap required, opened a new log
I20260811 01:38:29.647634 26820 ts_tablet_manager.cc:1397] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.001s
I20260811 01:38:29.648033 26819 ts_tablet_manager.cc:1428] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:38:29.648353 26209 catalog_manager.cc:4841] TS c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391): tablet f654d9d3e7554a6bbb22830388b8c975 (table test-table [id=2cafb1fae372460a92dd9b4afaf75bc0]) successfully deleted
I20260811 01:38:29.649899 26820 raft_consensus.cc:348] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.650307 26820 raft_consensus.cc:374] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.651722 26820 raft_consensus.cc:729] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6210e1dd54fa0989ae6e4a754c2be, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.652118 26820 consensus_queue.cc:260] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.652724 26820 ts_tablet_manager.cc:1428] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 01:38:29.654313 26818 tablet_bootstrap.cc:492] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: No bootstrap required, opened a new log
I20260811 01:38:29.654573 26818 ts_tablet_manager.cc:1397] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.001s
I20260811 01:38:29.655548 26818 raft_consensus.cc:348] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.656019 26818 raft_consensus.cc:374] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:29.656183 26818 raft_consensus.cc:729] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef76c98e9c3f4d07b4da710d29a17d2c, State: Initialized, Role: FOLLOWER
I20260811 01:38:29.656550 26818 consensus_queue.cc:260] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.657135 26818 ts_tablet_manager.cc:1428] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:38:29.840649 26829 raft_consensus.cc:482] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:38:29.840919 26829 raft_consensus.cc:504] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.841744 26829 leader_election.cc:288] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297)
I20260811 01:38:29.842578 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9cb8c8090c40b08a94784136e879fd" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" is_pre_election: true
I20260811 01:38:29.842602 26581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9cb8c8090c40b08a94784136e879fd" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" is_pre_election: true
I20260811 01:38:29.842872 26581 raft_consensus.cc:2454] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 0.
I20260811 01:38:29.842875 26414 raft_consensus.cc:2454] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 0.
I20260811 01:38:29.843474 26664 leader_election.cc:302] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bb6ccba7f34328afaa7daa71916659, ef76c98e9c3f4d07b4da710d29a17d2c; no voters:
I20260811 01:38:29.843796 26829 raft_consensus.cc:2781] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:38:29.843901 26829 raft_consensus.cc:482] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:38:29.844004 26829 raft_consensus.cc:3037] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.847357 26829 raft_consensus.cc:504] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.848057 26829 leader_election.cc:288] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 election: Requested vote from peers c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391), ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297)
I20260811 01:38:29.848685 26414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9cb8c8090c40b08a94784136e879fd" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be"
I20260811 01:38:29.848708 26581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9cb8c8090c40b08a94784136e879fd" candidate_uuid: "78bb6ccba7f34328afaa7daa71916659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c"
I20260811 01:38:29.848942 26581 raft_consensus.cc:3037] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.848940 26414 raft_consensus.cc:3037] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:29.852243 26414 raft_consensus.cc:2454] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 1.
I20260811 01:38:29.852483 26581 raft_consensus.cc:2454] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78bb6ccba7f34328afaa7daa71916659 in term 1.
I20260811 01:38:29.852933 26664 leader_election.cc:302] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78bb6ccba7f34328afaa7daa71916659, c6e6210e1dd54fa0989ae6e4a754c2be; no voters:
I20260811 01:38:29.853224 26829 raft_consensus.cc:2781] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:29.853930 26829 raft_consensus.cc:686] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 1 LEADER]: Becoming Leader. State: Replica: 78bb6ccba7f34328afaa7daa71916659, State: Running, Role: LEADER
I20260811 01:38:29.854286 26829 consensus_queue.cc:237] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } }
I20260811 01:38:29.857362 26225 catalog_manager.cc:5495] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3). New cstate: current_term: 1 leader_uuid: "78bb6ccba7f34328afaa7daa71916659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78bb6ccba7f34328afaa7daa71916659" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 43703 } health_report { overall_health: HEALTHY } } }
I20260811 01:38:29.900868 26905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.893014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.17.132.3:43703)
0811 01:38:29.893603 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.893609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.893630 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:38:29.893696 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.893703 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.893818 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.893912 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.894843 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.895929 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.898007 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.898651 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.898794 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.899482 (+ 688us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.899629 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.899722 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.900458 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.900555 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454}
I20260811 01:38:29.936887 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.928227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40703 (local address 127.17.132.1:42391)
0811 01:38:29.928445 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.928452 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.929132 (+ 680us) server_negotiation.cc:407] Connection header received
0811 01:38:29.929485 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.929491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.929616 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.929743 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.930406 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.931667 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.934088 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.934984 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.935202 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.935830 (+ 628us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.936012 (+ 182us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.936130 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:29.936427 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 01:38:29.936520 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:38:29.937302 26926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.928084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42391 (local address 127.17.132.3:40703)
0811 01:38:29.928993 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.929017 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.929292 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.929809 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.929818 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.929834 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:38:29.930207 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.930221 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.931860 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.931866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.933888 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.933908 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:29.935259 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:29.935269 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:29.935488 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:29.935586 (+ 98us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:38:29.936145 (+ 559us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:38:29.936169 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:38:29.936342 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 01:38:29.936515 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":541,"threads_started":1}
I20260811 01:38:29.951561 26581 raft_consensus.cc:1261] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Refusing update from remote peer 78bb6ccba7f34328afaa7daa71916659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.951653 26414 raft_consensus.cc:1261] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Refusing update from remote peer 78bb6ccba7f34328afaa7daa71916659: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:38:29.952425 26920 consensus_queue.cc:1035] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6210e1dd54fa0989ae6e4a754c2be" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:29.953078 26829 consensus_queue.cc:1035] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef76c98e9c3f4d07b4da710d29a17d2c" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:38:30.006702 26905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.997738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:58617 (local address 127.17.132.3:43703)
0811 01:38:29.997975 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:29.997981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:29.998192 (+ 211us) server_negotiation.cc:407] Connection header received
0811 01:38:29.998514 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:29.998520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:29.998632 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:29.998715 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:38:29.999593 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.000829 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.004116 (+ 3287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.004810 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.004935 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:30.005696 (+ 761us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:38:30.005903 (+ 207us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:38:30.005974 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:30.006221 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 01:38:30.006339 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:38:30.007592 26930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:29.997300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:43703 (local address 127.17.132.1:58617)
0811 01:38:29.998075 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:29.998098 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:29.998330 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:29.998961 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:29.998966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:29.998980 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:38:29.999375 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:29.999389 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.001056 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.001062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:30.003844 (+ 2782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:30.003872 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.005192 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.005202 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:30.005414 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:30.005475 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:38:30.006062 (+ 587us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:38:30.006073 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:38:30.006959 (+ 886us) client_negotiation.cc:240] Negotiation successful
0811 01:38:30.007147 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":692,"threads_started":1}
I20260811 01:38:30.072664 26225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:30.073017 26225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:38:30.076929 26225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7320a9486182474e834b0550bc141d2e: Sending DeleteTablet for 3 replicas of tablet 2e9cb8c8090c40b08a94784136e879fd
I20260811 01:38:30.078397 26556 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9cb8c8090c40b08a94784136e879fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:30 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:51832
I20260811 01:38:30.078751 26886 tablet_replica.cc:330] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: stopping tablet replica
I20260811 01:38:30.078974 26886 raft_consensus.cc:2229] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:30.079241 26886 raft_consensus.cc:2258] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:30.080695 26886 ts_tablet_manager.cc:1905] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:30.086378 26716 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9cb8c8090c40b08a94784136e879fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:30 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55880
I20260811 01:38:30.086752 26885 tablet_replica.cc:330] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: stopping tablet replica
I20260811 01:38:30.086872 26393 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9cb8c8090c40b08a94784136e879fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:38:30 UTC) from {username='oryx', principal='oryx/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:48826
I20260811 01:38:30.086972 26885 raft_consensus.cc:2229] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:38:30.087209 26884 tablet_replica.cc:330] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: stopping tablet replica
I20260811 01:38:30.087366 26885 raft_consensus.cc:2258] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:30.087421 26884 raft_consensus.cc:2229] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:38:30.087677 26884 raft_consensus.cc:2258] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:38:30.088918 26885 ts_tablet_manager.cc:1905] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:30.088970 26884 ts_tablet_manager.cc:1905] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:38:30.096058 26884 ts_tablet_manager.cc:1918] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:30.096240 26884 log.cc:1196] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/2e9cb8c8090c40b08a94784136e879fd
I20260811 01:38:30.096669 26884 ts_tablet_manager.cc:1939] T 2e9cb8c8090c40b08a94784136e879fd P c6e6210e1dd54fa0989ae6e4a754c2be: Deleting consensus metadata
I20260811 01:38:30.097923 26209 catalog_manager.cc:4841] TS c6e6210e1dd54fa0989ae6e4a754c2be (127.17.132.1:42391): tablet 2e9cb8c8090c40b08a94784136e879fd (table test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]) successfully deleted
I20260811 01:38:30.099068 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 26314
I20260811 01:38:30.106998 26886 ts_tablet_manager.cc:1918] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:30.109428 26885 ts_tablet_manager.cc:1918] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:38:30.110446 26885 log.cc:1196] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/2e9cb8c8090c40b08a94784136e879fd
I20260811 01:38:30.111116 26885 ts_tablet_manager.cc:1939] T 2e9cb8c8090c40b08a94784136e879fd P 78bb6ccba7f34328afaa7daa71916659: Deleting consensus metadata
I20260811 01:38:30.112922 26209 catalog_manager.cc:4841] TS 78bb6ccba7f34328afaa7daa71916659 (127.17.132.3:43703): tablet 2e9cb8c8090c40b08a94784136e879fd (table test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]) successfully deleted
I20260811 01:38:30.113562 26886 log.cc:1196] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/2e9cb8c8090c40b08a94784136e879fd
I20260811 01:38:30.114339 26886 ts_tablet_manager.cc:1939] T 2e9cb8c8090c40b08a94784136e879fd P ef76c98e9c3f4d07b4da710d29a17d2c: Deleting consensus metadata
I20260811 01:38:30.115832 26209 catalog_manager.cc:4841] TS ef76c98e9c3f4d07b4da710d29a17d2c (127.17.132.2:41297): tablet 2e9cb8c8090c40b08a94784136e879fd (table test-table [id=56c9ef7a6eaf4069a2b2159917b8d8ae]) successfully deleted
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.1@KRBTEST.COM
I20260811 01:38:30.134344 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:30.100521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48854 (local address 127.17.132.1:42391)
0811 01:38:30.100732 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:30.100739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:30.114504 (+ 13765us) server_negotiation.cc:407] Connection header received
0811 01:38:30.114847 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:30.114853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:30.114945 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:30.115024 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:30.116940 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.118189 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.120114 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.120923 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.121048 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:30.126393 (+ 5345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:30.126414 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:30.126433 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:30.126482 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:30.130874 (+ 4392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.131848 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.131862 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.131866 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.132080 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.132504 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.132510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.132513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.132997 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:30.133330 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:30.133662 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 01:38:30.133924 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:38:30.135288 26464 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:30.311527 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 26314
I20260811 01:38:30.343822 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 26477
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.2@KRBTEST.COM
I20260811 01:38:30.359884 26935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:30.344612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51856 (local address 127.17.132.2:41297)
0811 01:38:30.345144 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:30.345148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:30.345164 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:38:30.345218 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:30.345222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:30.345288 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:30.345414 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:30.346743 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.347431 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.348695 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.349118 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.349264 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:30.353925 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:30.353949 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:30.353973 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:30.354029 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:30.356866 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.357589 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.357597 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.357599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.357739 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.358213 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.358218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.358222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.358599 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:30.358917 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:30.359262 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:38:30.359503 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":277,"threads_started":1}
I20260811 01:38:30.360632 26632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:30.489545 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 26477
I20260811 01:38:30.517978 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 26641
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.132.3@KRBTEST.COM
I20260811 01:38:30.533849 26937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:30.518796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50078 (local address 127.17.132.3:43703)
0811 01:38:30.519272 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:30.519276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:30.519293 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:38:30.519351 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:30.519355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:30.519415 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:30.519507 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:30.520933 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.521722 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.523132 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:30.523592 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:30.523718 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:30.528217 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:30.528235 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:30.528252 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:30.528289 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:30.531221 (+ 2932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.531839 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.531846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.531848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.531978 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:30.532305 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:30.532308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:30.532310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:30.532663 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:30.532904 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:30.533190 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:38:30.533439 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":261,"threads_started":1}
I20260811 01:38:30.534536 26785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:30.664436 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 26641
I20260811 01:38:30.692883 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 26188
I20260811 01:38:30.694198 26270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:30.813381 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 26188
2026-08-11T01:38:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7543 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26942](info): set up 2 sockets
Aug 11 01:38:30 dist-test-slave-0kls krb5kdc[26942](info): commencing operation
krb5kdc: starting...
W20260811 01:38:31.982142 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.006s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:38:32 dist-test-slave-0kls krb5kdc[26942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:38:32.270489 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40379
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:32.621616 26956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:32.622015 26956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:32.622123 26956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:32.629592 26956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:32.629714 26956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:32.629760 26956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:32.629894 26956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:32.629947 26956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:32.640319 26956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:32.641649 26956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:32.643208 26956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:32.657109 26961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:32.657191 26964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:32.657142 26962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:32.657948 26956 server_base.cc:1034] running on GCE node
I20260811 01:38:32.658732 26956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:32.660208 26956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:32.661417 26956 hybrid_clock.cc:648] HybridClock initialized: now 1786412312661365 us; error 38 us; skew 500 ppm
I20260811 01:38:32.661857 26956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T01:38:32Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1917 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:38:32 dist-test-slave-0kls krb5kdc[26970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:38:32 dist-test-slave-0kls krb5kdc[26970](info): set up 2 sockets
Aug 11 01:38:32 dist-test-slave-0kls krb5kdc[26970](info): commencing operation
krb5kdc: starting...
W20260811 01:38:33.902081 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:38:34 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:38:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:38:34.194430 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34663
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:34.542091 26984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:34.542477 26984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:34.542663 26984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:34.550006 26984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:34.550202 26984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:34.550323 26984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:34.550431 26984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:34.550523 26984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:34.561864 26984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:34.563417 26984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:34.564929 26984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:34.578873 26992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:34.578812 26993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:34.578862 26995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:34.579488 26984 server_base.cc:1034] running on GCE node
I20260811 01:38:34.580541 26984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:34.582324 26984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:34.583597 26984 hybrid_clock.cc:648] HybridClock initialized: now 1786412314583554 us; error 61 us; skew 500 ppm
I20260811 01:38:34.584002 26984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:34 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:34.587414 26984 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:38:34.589017 26984 webserver.cc:460] Webserver started at http://127.17.132.62:35455/ using document root <none> and password file <none>
I20260811 01:38:34.589776 26984 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:34.589987 26984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:34.590332 26984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:34.594385 26984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "c7c27917d4064b729df7d92d6c4d333c"
format_stamp: "Formatted at 2026-08-11 01:38:34 on dist-test-slave-0kls"
server_key: "e42058db690d538eb10e8f452f9804b3"
server_key_iv: "a46e0b8d53618ae3f6db6f6541856f18"
server_key_version: "encryptionkey@0"
I20260811 01:38:34.595256 26984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "c7c27917d4064b729df7d92d6c4d333c"
format_stamp: "Formatted at 2026-08-11 01:38:34 on dist-test-slave-0kls"
server_key: "e42058db690d538eb10e8f452f9804b3"
server_key_iv: "a46e0b8d53618ae3f6db6f6541856f18"
server_key_version: "encryptionkey@0"
I20260811 01:38:34.600814 26984 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:34.604552 27002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:34.605998 26984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:34.606199 26984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "c7c27917d4064b729df7d92d6c4d333c"
format_stamp: "Formatted at 2026-08-11 01:38:34 on dist-test-slave-0kls"
server_key: "e42058db690d538eb10e8f452f9804b3"
server_key_iv: "a46e0b8d53618ae3f6db6f6541856f18"
server_key_version: "encryptionkey@0"
I20260811 01:38:34.606405 26984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:34.635231 26984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:34.639322 26984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:34.639624 26984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:34.659682 26984 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34663
I20260811 01:38:34.659690 27062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34663 every 8 connection(s)
I20260811 01:38:34.661254 26984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:34.663942 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 26984
I20260811 01:38:34.664189 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:34.664882 17936 external_mini_cluster.cc:1428] Setting key ce0a72f1432779a49b24a56f05b22e99
I20260811 01:38:34.665313 27063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:34.680719 27063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Bootstrap starting.
Aug 11 01:38:34 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:34.685102 27063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:34.686599 27063 log.cc:824] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:34.690455 27063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: No bootstrap required, opened a new log
I20260811 01:38:34.691608 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:34.666994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51340 (local address 127.17.132.62:34663)
0811 01:38:34.667916 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:34.667931 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:34.667981 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:38:34.670421 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:34.670450 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:34.670983 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:34.671456 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:34.672879 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:34.674911 (+ 2032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:34.676229 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:34.677389 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:34.677588 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:34.682046 (+ 4458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:34.682068 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:34.682088 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:34.682146 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:34.686474 (+ 4328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:34.687425 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:34.687433 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:34.687439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:34.687614 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:34.688219 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:34.688224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:34.688227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:34.688961 (+ 734us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:34.689279 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:34.689741 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 01:38:34.690234 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":369,"threads_started":1}
I20260811 01:38:34.699244 27063 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:34.699831 27063 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:34.699951 27063 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c27917d4064b729df7d92d6c4d333c, State: Initialized, Role: FOLLOWER
I20260811 01:38:34.700598 27063 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:34.700819 27063 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:34.700922 27063 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:34.701057 27063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:34.703339 27063 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:34.703831 27063 leader_election.cc:302] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7c27917d4064b729df7d92d6c4d333c; no voters:
I20260811 01:38:34.704437 27063 leader_election.cc:288] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:34.704615 27069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:34.705319 27069 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 LEADER]: Becoming Leader. State: Replica: c7c27917d4064b729df7d92d6c4d333c, State: Running, Role: LEADER
I20260811 01:38:34.705921 27069 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:34.706876 27063 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:34.709285 27071 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7c27917d4064b729df7d92d6c4d333c. Latest consensus state: current_term: 1 leader_uuid: "c7c27917d4064b729df7d92d6c4d333c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } } }
I20260811 01:38:34.709903 27071 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:34.709316 27070 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7c27917d4064b729df7d92d6c4d333c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } } }
I20260811 01:38:34.710346 27070 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:34.719399 27077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:34.725739 27077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:34.735649 27077 catalog_manager.cc:1347] Generated new cluster ID: eac3d32906cd4da4b287b4138eb84950
I20260811 01:38:34.735812 27077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:34.748741 27077 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:34.750912 27077 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:34.762992 27077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Generated new TSK 0
I20260811 01:38:34.764343 27077 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:38:34.842307 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:35.193737 27092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:35.194154 27092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:35.194316 27092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:35.202000 27092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:35.202167 27092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:35.202342 27092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:35.212952 27092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:35.214483 27092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:35.215876 27092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:35.230412 27097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:35.230322 27098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:35.230311 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:35.231803 27092 server_base.cc:1034] running on GCE node
I20260811 01:38:35.232517 27092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:35.233619 27092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:35.234874 27092 hybrid_clock.cc:648] HybridClock initialized: now 1786412315234825 us; error 68 us; skew 500 ppm
I20260811 01:38:35.235227 27092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:35 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412315, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:35.238839 27092 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:38:35.240684 27092 webserver.cc:460] Webserver started at http://127.17.132.1:33423/ using document root <none> and password file <none>
I20260811 01:38:35.241379 27092 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:35.241482 27092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:35.241768 27092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:35.244884 27092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "4895dd2d101f4ea8a8efa71026fad5fb"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "c4bdf22f04394ba75b472d9278d98457"
server_key_iv: "bec6243eddf359659d3989e7b0c2311b"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.245692 27092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "4895dd2d101f4ea8a8efa71026fad5fb"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "c4bdf22f04394ba75b472d9278d98457"
server_key_iv: "bec6243eddf359659d3989e7b0c2311b"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.252091 27092 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:38:35.256012 27110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.257645 27092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:38:35.257922 27092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "4895dd2d101f4ea8a8efa71026fad5fb"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "c4bdf22f04394ba75b472d9278d98457"
server_key_iv: "bec6243eddf359659d3989e7b0c2311b"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.258174 27092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:35.310132 27092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:35.314733 27092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:35.315009 27092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:35.316030 27092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:35.317464 27092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:35.317543 27092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.317646 27092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:35.317691 27092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.353103 27092 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42903
I20260811 01:38:35.353199 27235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42903 every 8 connection(s)
I20260811 01:38:35.354446 27092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:35.362888 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27092
I20260811 01:38:35.363183 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:35.363937 17936 external_mini_cluster.cc:1428] Setting key ee97d8052e13618d716d07b852f3ae7d
Aug 11 01:38:35 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412315, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:35.377553 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:35.357294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:56289 (local address 127.17.132.62:34663)
0811 01:38:35.357924 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:35.357929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:35.358677 (+ 748us) server_negotiation.cc:407] Connection header received
0811 01:38:35.360687 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:35.360693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:35.360796 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:35.360928 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:35.362654 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.363655 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.365813 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.366398 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.366553 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:35.370464 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:35.370473 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:35.370480 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:35.370526 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:35.374266 (+ 3740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:35.375057 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:35.375065 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:35.375071 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:35.375238 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:35.375749 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:35.375756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:35.375762 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:35.376161 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:35.376315 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:35.377098 (+ 783us) server_negotiation.cc:299] Negotiation successful
0811 01:38:35.377300 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":291,"threads_started":1}
I20260811 01:38:35.379206 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:35.357708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:56289)
0811 01:38:35.358496 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:35.358550 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:35.360385 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:35.361188 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:35.361197 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:35.361742 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:35.362402 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:35.362421 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.363857 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.363861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:35.365628 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:35.365644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.366666 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.366672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:35.366885 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:35.367614 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:35.367637 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:35.370207 (+ 2570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:35.374423 (+ 4216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:35.374431 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:35.374444 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:35.374917 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:35.375368 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:35.375372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:35.375374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:35.375610 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:35.376316 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:35.376322 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:35.376682 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 01:38:35.376921 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 01:38:35.377537 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":290,"threads_started":1}
I20260811 01:38:35.380834 27236 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34663
I20260811 01:38:35.381163 27236 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:35.381986 27236 heartbeater.cc:511] Master 127.17.132.62:34663 requested a full tablet report, sending...
I20260811 01:38:35.384153 27020 ts_manager.cc:194] Registered new tserver with Master: 4895dd2d101f4ea8a8efa71026fad5fb (127.17.132.1:42903)
I20260811 01:38:35.385643 27020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:56289
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:38:35.429174 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:35.787663 27243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:35.787959 27243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:35.788065 27243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:35.795564 27243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:35.795694 27243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:35.795810 27243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:35.806160 27243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:35.807662 27243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:35.809019 27243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:35.823402 27251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:35.823442 27249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:35.823372 27248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:35.824438 27243 server_base.cc:1034] running on GCE node
I20260811 01:38:35.825212 27243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:35.826340 27243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:35.827580 27243 hybrid_clock.cc:648] HybridClock initialized: now 1786412315827524 us; error 48 us; skew 500 ppm
I20260811 01:38:35.827980 27243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:35 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412315, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:35.831308 27243 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:38:35.832830 27243 webserver.cc:460] Webserver started at http://127.17.132.2:46245/ using document root <none> and password file <none>
I20260811 01:38:35.833544 27243 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:35.833658 27243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:35.834023 27243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:35.837018 27243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "1953cdfc43694619b32349fe8c0e6ae1"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "225b8d4271af1e41a26bb4974a5b43c3"
server_key_iv: "9cc5d94b4c19fcc1c18e8af7a7d1f586"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.837906 27243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "1953cdfc43694619b32349fe8c0e6ae1"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "225b8d4271af1e41a26bb4974a5b43c3"
server_key_iv: "9cc5d94b4c19fcc1c18e8af7a7d1f586"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.843539 27243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:38:35.847517 27261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.849009 27243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:35.849234 27243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "1953cdfc43694619b32349fe8c0e6ae1"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "225b8d4271af1e41a26bb4974a5b43c3"
server_key_iv: "9cc5d94b4c19fcc1c18e8af7a7d1f586"
server_key_version: "encryptionkey@0"
I20260811 01:38:35.849452 27243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:35.872833 27243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:35.877501 27243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:35.877899 27243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:35.879043 27243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:35.880533 27243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:35.880617 27243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.880709 27243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:35.880765 27243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:35.916155 27243 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:37451
I20260811 01:38:35.916307 27387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:37451 every 8 connection(s)
I20260811 01:38:35.917493 27243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:35.919310 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27243
I20260811 01:38:35.919548 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:35.920104 17936 external_mini_cluster.cc:1428] Setting key 0871a7685b85346b88419ebd607169e9
Aug 11 01:38:35 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412315, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:35.942287 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:35.920464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:55805 (local address 127.17.132.62:34663)
0811 01:38:35.920986 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:35.920993 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:35.921974 (+ 981us) server_negotiation.cc:407] Connection header received
0811 01:38:35.924812 (+ 2838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:35.924816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:35.924878 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:35.924969 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:35.927100 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.927802 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.930374 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.930788 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.930886 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:35.935534 (+ 4648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:35.935540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:35.935543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:35.935583 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:35.938458 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:35.939583 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:35.939589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:35.939591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:35.939741 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:35.940281 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:35.940284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:35.940286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:35.940581 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:35.940697 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:35.941732 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0811 01:38:35.941999 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":261,"threads_started":1}
I20260811 01:38:35.943944 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:35.920999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:55805)
0811 01:38:35.921771 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:35.921874 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:35.924489 (+ 2615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:35.925246 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:35.925260 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:35.926092 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:35.926909 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:35.926943 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.927970 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.927978 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:35.930203 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:35.930222 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:35.931037 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:35.931046 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:35.931403 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:35.932269 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:35.932306 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:35.935216 (+ 2910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:35.938668 (+ 3452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:35.938682 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:35.938705 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:35.939404 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:35.939879 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:35.939887 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:35.939893 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:35.940166 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:35.940735 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:35.940746 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:35.941274 (+ 528us) client_negotiation.cc:769] Sending connection context
0811 01:38:35.941599 (+ 325us) client_negotiation.cc:240] Negotiation successful
0811 01:38:35.942291 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":319,"threads_started":1}
I20260811 01:38:35.945642 27388 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34663
I20260811 01:38:35.946033 27388 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:35.946856 27388 heartbeater.cc:511] Master 127.17.132.62:34663 requested a full tablet report, sending...
I20260811 01:38:35.948560 27020 ts_manager.cc:194] Registered new tserver with Master: 1953cdfc43694619b32349fe8c0e6ae1 (127.17.132.2:37451)
I20260811 01:38:35.949443 27020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:55805
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:38:35.989023 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:36.348448 27394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:36.348819 27394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:36.348994 27394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:36.359174 27394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:36.359321 27394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:36.359500 27394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:36.369603 27394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:36.371017 27394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:36.372344 27394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:36.386346 27405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:36.386368 27401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:36.386453 27400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:36.387125 27394 server_base.cc:1034] running on GCE node
I20260811 01:38:36.387852 27394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:36.388787 27236 heartbeater.cc:503] Master 127.17.132.62:34663 was elected leader, sending a full tablet report...
I20260811 01:38:36.389168 27394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:36.390465 27394 hybrid_clock.cc:648] HybridClock initialized: now 1786412316390363 us; error 55 us; skew 500 ppm
I20260811 01:38:36.390909 27394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:36 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412316, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:36.394309 27394 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:38:36.395957 27394 webserver.cc:460] Webserver started at http://127.17.132.3:39967/ using document root <none> and password file <none>
I20260811 01:38:36.396731 27394 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:36.396896 27394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:36.397248 27394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:36.400648 27394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "b325c16bb745488fa0969e38a514dc2f"
format_stamp: "Formatted at 2026-08-11 01:38:36 on dist-test-slave-0kls"
server_key: "319e7ca67015c90fcaf4b275d350104f"
server_key_iv: "544f1ff62d5e902db2d42e50ce7dbf10"
server_key_version: "encryptionkey@0"
I20260811 01:38:36.401590 27394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "b325c16bb745488fa0969e38a514dc2f"
format_stamp: "Formatted at 2026-08-11 01:38:36 on dist-test-slave-0kls"
server_key: "319e7ca67015c90fcaf4b275d350104f"
server_key_iv: "544f1ff62d5e902db2d42e50ce7dbf10"
server_key_version: "encryptionkey@0"
I20260811 01:38:36.407573 27394 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 01:38:36.411686 27412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:36.413201 27394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:36.413414 27394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "b325c16bb745488fa0969e38a514dc2f"
format_stamp: "Formatted at 2026-08-11 01:38:36 on dist-test-slave-0kls"
server_key: "319e7ca67015c90fcaf4b275d350104f"
server_key_iv: "544f1ff62d5e902db2d42e50ce7dbf10"
server_key_version: "encryptionkey@0"
I20260811 01:38:36.413668 27394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:36.425014 27394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:36.429479 27394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:36.429840 27394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:36.430845 27394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:36.432240 27394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:36.432341 27394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:36.432487 27394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:36.432560 27394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:36.468614 27394 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:37757
I20260811 01:38:36.468677 27538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:37757 every 8 connection(s)
I20260811 01:38:36.470191 27394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:36.473088 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27394
I20260811 01:38:36.473315 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:36.473930 17936 external_mini_cluster.cc:1428] Setting key 1bb4568c5a3fe325e0de985ff97a3a65
Aug 11 01:38:36 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412316, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:38:36.510035 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:36.474015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:58427 (local address 127.17.132.62:34663)
0811 01:38:36.478626 (+ 4611us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:36.478642 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:36.487357 (+ 8715us) server_negotiation.cc:407] Connection header received
0811 01:38:36.490378 (+ 3021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:36.490387 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:36.490497 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:36.490654 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:36.492551 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.493923 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.496514 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.497039 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.497185 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:36.502224 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:36.502237 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:36.502241 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:36.502280 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:36.506294 (+ 4014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.507341 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.507349 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.507352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.507498 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.508031 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.508036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.508040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.508353 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:36.508524 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:36.509334 (+ 810us) server_negotiation.cc:299] Negotiation successful
0811 01:38:36.509573 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4438,"thread_start_us":1086,"threads_started":1}
I20260811 01:38:36.511175 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:36.474582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:58427)
0811 01:38:36.487119 (+ 12537us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:36.487167 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:36.489883 (+ 2716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:36.490935 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:36.490944 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:36.491497 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:36.492310 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:36.492339 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.494129 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.494135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:36.496282 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:36.496301 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.497517 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.497527 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:36.497941 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:36.498846 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:36.498883 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:36.501950 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:36.506474 (+ 4524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:36.506485 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:36.506515 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:36.507208 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:36.507641 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:38:36.507646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:38:36.507650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:38:36.507896 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:38:36.508489 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:36.508497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:36.508895 (+ 398us) client_negotiation.cc:769] Sending connection context
0811 01:38:36.509228 (+ 333us) client_negotiation.cc:240] Negotiation successful
0811 01:38:36.509916 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12195,"thread_start_us":15134,"threads_started":1}
I20260811 01:38:36.512718 27539 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34663
I20260811 01:38:36.513091 27539 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:36.514072 27539 heartbeater.cc:511] Master 127.17.132.62:34663 requested a full tablet report, sending...
I20260811 01:38:36.515813 27020 ts_manager.cc:194] Registered new tserver with Master: b325c16bb745488fa0969e38a514dc2f (127.17.132.3:37757)
I20260811 01:38:36.516675 27020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:58427
I20260811 01:38:36.520300 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
Entry for principal oryx/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab.
WARNING: no policy specified for oryx/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
Entry for principal oryx/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab.
WARNING: no policy specified for oryx/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
Entry for principal oryx/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab.
I20260811 01:38:36.712613 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27092
Aug 11 01:38:36 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:38:36.731089 27550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:36.713872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50240 (local address 127.17.132.1:42903)
0811 01:38:36.714637 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:36.714645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:36.714673 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:38:36.714740 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:36.714746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:36.714964 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:36.715116 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:36.716692 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.718032 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.719499 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.720179 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.720296 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:36.724810 (+ 4514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:36.724826 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:36.724843 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:36.724889 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:36.728135 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.728937 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.728946 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.728948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.729093 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.729507 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.729510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.729512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.730007 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:36.730274 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:36.730569 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 01:38:36.730801 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":411,"threads_started":1}
I20260811 01:38:36.732431 27230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:36.821065 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27092
I20260811 01:38:36.842602 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27243
Aug 11 01:38:36 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:38:36.860544 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:36.843538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.17.132.2:37451)
0811 01:38:36.844182 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:36.844189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:36.844216 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:38:36.844278 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:36.844284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:36.844516 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:36.844656 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:36.846062 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.847254 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.848789 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.849425 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.849536 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:36.854663 (+ 5127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:36.854675 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:36.854691 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:36.854739 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:36.857948 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.858644 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.858651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.858654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.858788 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.859130 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.859134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.859136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.859486 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:36.859733 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:36.860015 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:38:36.860237 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":320,"threads_started":1}
I20260811 01:38:36.861951 27382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:36.947826 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27243
I20260811 01:38:36.966140 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27394
Aug 11 01:38:36 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:38:36.984846 27554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:36.967384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37508 (local address 127.17.132.3:37757)
0811 01:38:36.968019 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:36.968026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:36.968058 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:36.968120 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:36.968135 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:36.968359 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:36.968493 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:36.969885 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.970939 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.972653 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:36.973260 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:36.973375 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:36.978281 (+ 4906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:36.978297 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:36.978314 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:36.978353 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:36.981467 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.982450 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.982459 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.982461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.982618 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:36.983015 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:36.983020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:36.983022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:36.983461 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:36.983735 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:36.984160 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 01:38:36.984389 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":327,"threads_started":1}
I20260811 01:38:36.986444 27533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:37.072777 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27394
I20260811 01:38:37.093042 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 26984
I20260811 01:38:37.094446 27057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:37.200080 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 26984
I20260811 01:38:37.225111 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34663
--webserver_interface=127.17.132.62
--webserver_port=35455
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:38:37.589532 27557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:37.589936 27557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:37.590050 27557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:37.597841 27557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:37.597990 27557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:37.598040 27557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:37.598105 27557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:37.598155 27557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:37.609200 27557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=35455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:37.610738 27557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:37.612051 27557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:37.624825 27565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:37.624764 27567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:37.625299 27564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:37.626101 27557 server_base.cc:1034] running on GCE node
I20260811 01:38:37.626937 27557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:37.628420 27557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:37.629670 27557 hybrid_clock.cc:648] HybridClock initialized: now 1786412317629618 us; error 83 us; skew 500 ppm
I20260811 01:38:37.630070 27557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:37 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412317, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:37.633237 27557 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:38:37.634943 27557 webserver.cc:460] Webserver started at http://127.17.132.62:35455/ using document root <none> and password file <none>
I20260811 01:38:37.635703 27557 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:37.635871 27557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:37.642700 27557 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:38:37.645880 27577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:37.647473 27557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:38:37.647697 27557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "c7c27917d4064b729df7d92d6c4d333c"
format_stamp: "Formatted at 2026-08-11 01:38:34 on dist-test-slave-0kls"
server_key: "e42058db690d538eb10e8f452f9804b3"
server_key_iv: "a46e0b8d53618ae3f6db6f6541856f18"
server_key_version: "encryptionkey@0"
I20260811 01:38:37.648783 27557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:37.668507 27557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:37.678149 27557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:37.678473 27557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:37.700225 27557 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34663
I20260811 01:38:37.700259 27633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34663 every 8 connection(s)
I20260811 01:38:37.702092 27557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:37.705672 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27557
I20260811 01:38:37.706545 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:42903
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:34663
--webserver_port=33423
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:38:37.710410 27634 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:38:37.714148 27634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Bootstrap starting.
I20260811 01:38:37.734906 27634 log.cc:824] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:37.744796 27634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:38:37.745433 27634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Bootstrap complete.
I20260811 01:38:37.755404 27634 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:37.756346 27634 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c27917d4064b729df7d92d6c4d333c, State: Initialized, Role: FOLLOWER
I20260811 01:38:37.756996 27634 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:37.757278 27634 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:37.757416 27634 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:37.757619 27634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:38:37.761746 27634 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:37.762401 27634 leader_election.cc:302] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7c27917d4064b729df7d92d6c4d333c; no voters:
I20260811 01:38:37.763093 27634 leader_election.cc:288] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:38:37.763249 27639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:38:37.764566 27639 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [term 2 LEADER]: Becoming Leader. State: Replica: c7c27917d4064b729df7d92d6c4d333c, State: Running, Role: LEADER
I20260811 01:38:37.765298 27639 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } }
I20260811 01:38:37.765661 27634 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:37.768189 27640 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c7c27917d4064b729df7d92d6c4d333c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } } }
I20260811 01:38:37.768685 27640 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:37.771073 27641 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7c27917d4064b729df7d92d6c4d333c. Latest consensus state: current_term: 2 leader_uuid: "c7c27917d4064b729df7d92d6c4d333c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c27917d4064b729df7d92d6c4d333c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34663 } } }
I20260811 01:38:37.771473 27641 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:37.773347 27645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:37.780742 27645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:37.782464 27645 catalog_manager.cc:1259] Loaded cluster ID: eac3d32906cd4da4b287b4138eb84950
I20260811 01:38:37.782698 27645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:37.786929 27645 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:37.788549 27645 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c7c27917d4064b729df7d92d6c4d333c: Loaded TSK: 0
I20260811 01:38:37.790247 27645 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:38:38.087101 27637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:38.087435 27637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:38.087594 27637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:38.095345 27637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:38.095463 27637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:38.095633 27637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:38.106071 27637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.1.keytab
--principal=oryx/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:42903
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=33423
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:38.107475 27637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:38.108795 27637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:38.124153 27665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:38.124430 27662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:38.124224 27663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:38.125193 27637 server_base.cc:1034] running on GCE node
I20260811 01:38:38.125934 27637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:38.126943 27637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:38.128177 27637 hybrid_clock.cc:648] HybridClock initialized: now 1786412318128120 us; error 47 us; skew 500 ppm
I20260811 01:38:38.128504 27637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412318, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:38.131909 27637 init.cc:377] Logged in from keytab as oryx/127.17.132.1@KRBTEST.COM (short username oryx)
I20260811 01:38:38.133576 27637 webserver.cc:460] Webserver started at http://127.17.132.1:33423/ using document root <none> and password file <none>
I20260811 01:38:38.134346 27637 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:38.134498 27637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:38.140187 27637 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 01:38:38.143136 27672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:38.144590 27637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:38:38.144779 27637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "4895dd2d101f4ea8a8efa71026fad5fb"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "c4bdf22f04394ba75b472d9278d98457"
server_key_iv: "bec6243eddf359659d3989e7b0c2311b"
server_key_version: "encryptionkey@0"
I20260811 01:38:38.145872 27637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:38.184504 27637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:38.189085 27637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:38.189402 27637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:38.190594 27637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:38.192071 27637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:38.192239 27637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 01:38:38.192365 27637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:38.192456 27637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:38.228590 27637 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42903
I20260811 01:38:38.228680 27795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42903 every 8 connection(s)
I20260811 01:38:38.230224 27637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:38.237512 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27637
I20260811 01:38:38.238340 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:37451
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:34663
--webserver_port=46245
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:38.605401 27800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:38.605783 27800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:38.605999 27800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:38.613703 27800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:38.613940 27800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:38.614152 27800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:38.624639 27800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.2.keytab
--principal=oryx/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:37451
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=46245
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:38.626169 27800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:38.627498 27800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:38.643368 27806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:38.644001 27807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:38.644984 27809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:38.645896 27800 server_base.cc:1034] running on GCE node
I20260811 01:38:38.646720 27800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:38.648001 27800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:38.649320 27800 hybrid_clock.cc:648] HybridClock initialized: now 1786412318649263 us; error 44 us; skew 500 ppm
I20260811 01:38:38.649732 27800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412318, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:38.654309 27800 init.cc:377] Logged in from keytab as oryx/127.17.132.2@KRBTEST.COM (short username oryx)
I20260811 01:38:38.656236 27800 webserver.cc:460] Webserver started at http://127.17.132.2:46245/ using document root <none> and password file <none>
I20260811 01:38:38.656986 27800 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:38.657153 27800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:38.664755 27800 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:38:38.669749 27818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:38.671537 27800 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:38:38.671772 27800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "1953cdfc43694619b32349fe8c0e6ae1"
format_stamp: "Formatted at 2026-08-11 01:38:35 on dist-test-slave-0kls"
server_key: "225b8d4271af1e41a26bb4974a5b43c3"
server_key_iv: "9cc5d94b4c19fcc1c18e8af7a7d1f586"
server_key_version: "encryptionkey@0"
I20260811 01:38:38.673029 27800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:38.703384 27800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:38.708125 27800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:38.708441 27800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:38.709774 27800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:38.711477 27800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:38.711615 27800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:38.711768 27800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:38.711867 27800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:38.763139 27800 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:37451
I20260811 01:38:38.763186 27942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:37451 every 8 connection(s)
I20260811 01:38:38.764855 27800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:38.775189 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27800
I20260811 01:38:38.775813 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:37757
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:34663
--webserver_port=39967
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:36527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:38 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:39.419909 27947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:39.420269 27947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:39.420450 27947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:39.428334 27947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:39.428494 27947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:39.428701 27947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:39.439576 27947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/krb5kdc/oryx_127.17.132.3.keytab
--principal=oryx/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:37757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=39967
--tserver_master_addrs=127.17.132.62:34663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:39.441176 27947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:39.442771 27947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:39.462260 27955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:39.463449 27953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:39.465286 27957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:39.467059 27947 server_base.cc:1034] running on GCE node
I20260811 01:38:39.468081 27947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:39.469859 27947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:39.473323 27947 hybrid_clock.cc:648] HybridClock initialized: now 1786412319473191 us; error 106 us; skew 500 ppm
I20260811 01:38:39.474197 27947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412319, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:38:39.481149 27947 init.cc:377] Logged in from keytab as oryx/127.17.132.3@KRBTEST.COM (short username oryx)
I20260811 01:38:39.485776 27947 webserver.cc:460] Webserver started at http://127.17.132.3:39967/ using document root <none> and password file <none>
I20260811 01:38:39.487447 27947 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:39.487722 27947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:39.500658 27947 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.007s sys 0.001s
I20260811 01:38:39.506647 27964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:39.509447 27947 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.001s
I20260811 01:38:39.509843 27947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "b325c16bb745488fa0969e38a514dc2f"
format_stamp: "Formatted at 2026-08-11 01:38:36 on dist-test-slave-0kls"
server_key: "319e7ca67015c90fcaf4b275d350104f"
server_key_iv: "544f1ff62d5e902db2d42e50ce7dbf10"
server_key_version: "encryptionkey@0"
I20260811 01:38:39.512393 27947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 01:38:39.514739 27798 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.269s user 0.006s sys 0.012s
W20260811 01:38:39.516798 27799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:38.233326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:46645 (local address 127.17.132.62:34663)
0811 01:38:38.234082 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:38.234094 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:38.234372 (+ 278us) server_negotiation.cc:407] Connection header received
0811 01:38:38.236589 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:38.236605 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:38.236970 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:38.237308 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:38.239471 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.240773 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.243352 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.244014 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.244180 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.516022 (+1271842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:46645: BlockingRecv error: recv got EOF from 127.17.132.1:46645 (error 108)
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":300,"threads_started":1}
I20260811 01:38:39.516796 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:38.233314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:46645)
0811 01:38:38.234173 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:38.234226 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:38.236007 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:38.237581 (+ 1574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:38.237595 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:38.238418 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:38.239238 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:38.239272 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.240983 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.240992 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:38.243167 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:38.243186 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.244281 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.244290 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:38.244629 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:38.245512 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:38.245548 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:39.515584 (+1270036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":358,"threads_started":1}
W20260811 01:38:39.518172 27796 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34663 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.132.62:34663: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:39.535369 27799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:39.519404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:33525 (local address 127.17.132.62:34663)
0811 01:38:39.519673 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:39.519683 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:39.519718 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:38:39.519840 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:39.519849 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:39.519972 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:39.520162 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:39.521196 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.522491 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.525556 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.526423 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.526613 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.535129 (+ 8516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:33525: BlockingRecv error: recv got EOF from 127.17.132.1:33525 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:38:39.535746 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:39.519184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:33525)
0811 01:38:39.519485 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:39.519507 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:39.519633 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:39.520231 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:39.520235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:39.520726 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:39.520960 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.520973 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.522723 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.522735 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.525307 (+ 2572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.525333 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.526717 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.526729 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.527069 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.527994 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:39.528048 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:39.534858 (+ 6810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169}
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:39.548660 27947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:39.550554 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:39.537056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:60247)
0811 01:38:39.537568 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:39.537597 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:39.537816 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:39.538281 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:39.538289 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:39.538946 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:39.539295 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.539315 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.540788 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.540797 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.543400 (+ 2603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.543426 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.544418 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.544424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.544653 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.545255 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:39.545278 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:39.550245 (+ 4967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":342}
W20260811 01:38:39.550763 27799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:39.537294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:60247 (local address 127.17.132.62:34663)
0811 01:38:39.537507 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:39.537514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:39.537695 (+ 181us) server_negotiation.cc:407] Connection header received
0811 01:38:39.537968 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:39.537973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:39.538071 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:39.538178 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:39.539487 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.540597 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.543602 (+ 3005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.544241 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.544388 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.550501 (+ 6113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:60247: BlockingRecv error: recv got EOF from 127.17.132.1:60247 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 01:38:39.551177 27796 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:38:39.555495 27947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:39.555825 27947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:39.557003 27947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:39.558738 27947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:39.558872 27947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:39.559008 27947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:39.559099 27947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:39.610456 27947 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:37757
I20260811 01:38:39.610689 28096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:37757 every 8 connection(s)
I20260811 01:38:39.612085 27947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:39.613310 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 27947
I20260811 01:38:39.636545 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:39.618046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51354 (local address 127.17.132.62:34663)
0811 01:38:39.618343 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:39.618353 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:39.618385 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:39.618478 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:39.618486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:39.618615 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:39.618778 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:39.621707 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.623213 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.626430 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.626872 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.627030 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.629897 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:39.629907 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:39.629933 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:39.629977 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:39.633096 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:39.633866 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:39.633882 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:39.633889 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:39.634081 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:38:39.634489 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:38:39.634495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:38:39.634498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:38:39.634992 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:39.635335 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:39.635821 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 01:38:39.636230 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:39 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:40.072074 27946 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.286s user 0.007s sys 0.022s
W20260811 01:38:40.073922 27945 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:38.768081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:46507 (local address 127.17.132.62:34663)
0811 01:38:38.768723 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:38.768730 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:38.769932 (+ 1202us) server_negotiation.cc:407] Connection header received
0811 01:38:38.774034 (+ 4102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:38.774038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:38.774188 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:38.774287 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:38.777435 (+ 3148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.778842 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.782531 (+ 3689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.783558 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.783740 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.073604 (+1289864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:46507: BlockingRecv error: recv got EOF from 127.17.132.2:46507 (error 108)
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":319,"threads_started":1}
I20260811 01:38:40.075598 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:38.768521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:46507)
0811 01:38:38.769676 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:38.769744 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:38.773403 (+ 3659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:38.774756 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:38.774775 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:38.775947 (+ 1172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:38.777173 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:38.777211 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.779081 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.779090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:38.782227 (+ 3137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:38.782256 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:38.784278 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:38.784290 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:38.784924 (+ 634us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:38.786040 (+ 1116us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:38.786101 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.073590 (+1287489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":401,"threads_started":1}
W20260811 01:38:40.076629 27943 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34663 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.132.62:34663: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:40.090649 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:40.077373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:40391)
0811 01:38:40.077690 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:40.077721 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:40.077961 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:40.078474 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:40.078482 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:40.079224 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:40.079554 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.079585 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.080804 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.080813 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.083251 (+ 2438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.083276 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.084244 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.084255 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.084532 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.085554 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:40.085604 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.090418 (+ 4814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":77}
W20260811 01:38:40.091208 27945 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:40.077412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:40391 (local address 127.17.132.62:34663)
0811 01:38:40.077589 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:40.077593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:40.077843 (+ 250us) server_negotiation.cc:407] Connection header received
0811 01:38:40.078142 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:40.078149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:40.078225 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:40.078309 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:40.079790 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.080624 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.083450 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.083999 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.084138 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.090848 (+ 6710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:40391: BlockingRecv error: recv got EOF from 127.17.132.2:40391 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:40.102238 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:40.091440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:56219)
0811 01:38:40.091831 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:40.091850 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:40.091987 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:40.092382 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:40.092387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:40.092723 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:40.092875 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.092884 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.093980 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.093986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.094946 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.094956 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.095776 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.096182 (+ 406us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.096557 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.097421 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:40.097455 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.101941 (+ 4486us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284}
W20260811 01:38:40.102468 27945 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:40.091645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:56219 (local address 127.17.132.62:34663)
0811 01:38:40.091825 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:40.091830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:40.091926 (+ 96us) server_negotiation.cc:407] Connection header received
0811 01:38:40.092120 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:40.092126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:40.092221 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:40.092327 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:40.093021 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.093778 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.095095 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.095553 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.095680 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.102165 (+ 6485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:56219: BlockingRecv error: recv got EOF from 127.17.132.2:56219 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 01:38:40.102587 27943 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:40.562588 28105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:40.552196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:52077)
0811 01:38:40.552983 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:40.553009 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:40.553166 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:40.553804 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:40.553809 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:40.554356 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:40.554570 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.554587 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.555663 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.555669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.556723 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.556737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.557535 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.557542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.557726 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.558501 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:40.558520 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.562217 (+ 3697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":515,"threads_started":1}
W20260811 01:38:40.562724 27945 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:40.552296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:52077 (local address 127.17.132.62:34663)
0811 01:38:40.552504 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:40.552510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:40.553140 (+ 630us) server_negotiation.cc:407] Connection header received
0811 01:38:40.553354 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:40.553364 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:40.553551 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:40.553753 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:40.554790 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.555512 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.556881 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.557324 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.557469 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.562480 (+ 5011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:52077: BlockingRecv error: recv got EOF from 127.17.132.1:52077 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 01:38:40.777037 28103 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.130s user 0.005s sys 0.012s
W20260811 01:38:40.778507 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:39.619315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:48517 (local address 127.17.132.62:34663)
0811 01:38:39.626347 (+ 7032us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:39.626355 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:39.630517 (+ 4162us) server_negotiation.cc:407] Connection header received
0811 01:38:39.636249 (+ 5732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:39.636262 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:39.636389 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:39.636514 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:39.640404 (+ 3890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.641371 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.644973 (+ 3602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.645386 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.645492 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.778214 (+1132722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:48517: BlockingRecv error: recv got EOF from 127.17.132.3:48517 (error 108)
Metrics: {"server-negotiator.queue_time_us":6836,"thread_start_us":6646,"threads_started":1}
I20260811 01:38:40.779080 28103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:39.617580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:48517)
0811 01:38:39.630239 (+ 12659us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:39.630336 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:39.635690 (+ 5354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:39.638531 (+ 2841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:39.638548 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:39.639342 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:39.640211 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.640234 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.641587 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.641597 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.644751 (+ 3154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:39.644778 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:39.645704 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:39.645714 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:39.646232 (+ 518us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:39.647221 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:39.647271 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.778015 (+1130744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":12107,"thread_start_us":14597,"threads_started":1}
W20260811 01:38:40.780292 28097 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34663 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.132.62:34663: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:40.790787 28103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:40.781141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:48921)
0811 01:38:40.781386 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:40.781404 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:40.781513 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:40.781888 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:40.781891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:40.782274 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:40.782456 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.782464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.783662 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.783669 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.784684 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.784697 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.785505 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.785510 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.785643 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.786411 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:40.786430 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.790438 (+ 4008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 01:38:40.790911 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:40.781214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:48921 (local address 127.17.132.62:34663)
0811 01:38:40.781491 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:40.781496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:40.781517 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:38:40.781629 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:40.781633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:40.781697 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:40.781837 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:40.782638 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.783480 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.784835 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.785312 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.785418 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.790670 (+ 5252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:48921: BlockingRecv error: recv got EOF from 127.17.132.3:48921 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:40 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:40.801498 28103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:40.791582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:36297)
0811 01:38:40.791798 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:40.791818 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:40.791944 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:40.792328 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:40.792333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:40.792732 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:40.792902 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.792911 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.794130 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.794134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.795144 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:40.795156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.795925 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.795930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:40.796075 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.796686 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:40.796704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:40.801147 (+ 4443us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 01:38:40.801838 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:40.791676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:36297 (local address 127.17.132.62:34663)
0811 01:38:40.791865 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:40.791871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:40.791890 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:38:40.792072 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:40.792078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:40.792179 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:40.792286 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:40.793100 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.793955 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.795299 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:40.795767 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:40.795869 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:40.801437 (+ 5568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:36297: BlockingRecv error: recv got EOF from 127.17.132.3:36297 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 01:38:40.802089 28097 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:41.113765 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:41.103294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:39051)
0811 01:38:41.103999 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:41.104015 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:41.104187 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:41.104567 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:41.104572 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:41.105025 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:41.105191 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.105201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.106296 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.106302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.107275 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.107286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.108037 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.108044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.108227 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.108878 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:41.108897 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:41.113342 (+ 4445us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":380,"threads_started":1}
W20260811 01:38:41.114073 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:41.103498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:39051 (local address 127.17.132.62:34663)
0811 01:38:41.103771 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:41.103780 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:41.104144 (+ 364us) server_negotiation.cc:407] Connection header received
0811 01:38:41.104332 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:41.104342 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:41.104413 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:41.104523 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:41.105359 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.106146 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.107425 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.107841 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.107984 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.113734 (+ 5750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:39051: BlockingRecv error: recv got EOF from 127.17.132.2:39051 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:41.574482 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:41.564235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:42103)
0811 01:38:41.564773 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:41.564795 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:41.564962 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:41.565334 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:41.565339 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:41.565908 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:41.566135 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.566145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.567307 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.567314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.568246 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.568258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.568994 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.569000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.569189 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.569842 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:41.569861 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:41.574199 (+ 4338us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":303,"threads_started":1}
W20260811 01:38:41.574774 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:41.564307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:42103 (local address 127.17.132.62:34663)
0811 01:38:41.564562 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:41.564570 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:41.564884 (+ 314us) server_negotiation.cc:407] Connection header received
0811 01:38:41.565123 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:41.565127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:41.565191 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:41.565299 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:41.566289 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.567160 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.568394 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.568825 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.568962 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.574430 (+ 5468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:42103: BlockingRecv error: recv got EOF from 127.17.132.1:42103 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:41 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:41.812513 28110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:41.802732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:36763)
0811 01:38:41.803298 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:41.803315 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:41.803438 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:41.803891 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:41.803895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:41.804339 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:41.804495 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.804504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.805598 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.805603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.806623 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:41.806636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.807448 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.807453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:41.807578 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.808309 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:41.808328 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:41.812166 (+ 3838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":322,"threads_started":1}
W20260811 01:38:41.812729 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:41.802857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:36763 (local address 127.17.132.62:34663)
0811 01:38:41.803135 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:41.803141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:41.803403 (+ 262us) server_negotiation.cc:407] Connection header received
0811 01:38:41.803611 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:41.803616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:41.803705 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:41.803798 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:41.804710 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.805437 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.806791 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:41.807261 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:41.807371 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:41.812464 (+ 5093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:36763: BlockingRecv error: recv got EOF from 127.17.132.3:36763 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:42.124536 28111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:42.114972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:55567)
0811 01:38:42.115627 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:42.115643 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:42.115766 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:42.116106 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:42.116109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:42.116528 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:42.116722 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.116731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.117810 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.117815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.118752 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.118765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.119467 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.119471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.119599 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.120350 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:42.120368 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:42.124287 (+ 3919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":400,"threads_started":1}
W20260811 01:38:42.125016 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:42.115133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:55567 (local address 127.17.132.62:34663)
0811 01:38:42.115338 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:42.115343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:42.115753 (+ 410us) server_negotiation.cc:407] Connection header received
0811 01:38:42.115872 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:42.115876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:42.115944 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:42.116033 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:42.116889 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.117634 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.118895 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.119323 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.119421 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.124560 (+ 5139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:55567: BlockingRecv error: recv got EOF from 127.17.132.2:55567 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:42.585502 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:42.575523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:57995)
0811 01:38:42.576140 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:42.576168 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:42.576353 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:42.576745 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:42.576749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:42.577322 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:42.577569 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.577596 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.578778 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.578784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.579720 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.579732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.580529 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.580534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.580741 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.581549 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:42.581569 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:42.585222 (+ 3653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":328,"threads_started":1}
W20260811 01:38:42.585698 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:42.575803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:57995 (local address 127.17.132.62:34663)
0811 01:38:42.576052 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:42.576058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:42.576273 (+ 215us) server_negotiation.cc:407] Connection header received
0811 01:38:42.576489 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:42.576498 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:42.576585 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:42.576696 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:42.577764 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.578626 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.579886 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.580377 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.580514 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.585430 (+ 4916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:57995: BlockingRecv error: recv got EOF from 127.17.132.1:57995 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:42 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:42.828104 28114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:42.813989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:33501)
0811 01:38:42.814757 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:42.814773 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:42.814942 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:42.815346 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:42.815351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:42.815854 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:42.816046 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.816056 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.817129 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.817137 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.818175 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:42.818188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.818912 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.818918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:42.819103 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.823662 (+ 4559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:42.823681 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:42.827731 (+ 4050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":315,"threads_started":1}
W20260811 01:38:42.828306 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:42.814323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:33501 (local address 127.17.132.62:34663)
0811 01:38:42.814534 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:42.814540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:42.814873 (+ 333us) server_negotiation.cc:407] Connection header received
0811 01:38:42.815084 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:42.815090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:42.815176 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:42.815308 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:42.816213 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.816987 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.818316 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:42.818750 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:42.818890 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:42.827984 (+ 9094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:33501: BlockingRecv error: recv got EOF from 127.17.132.3:33501 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:43.134840 28115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:43.125565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:54009)
0811 01:38:43.126157 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:43.126173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:43.126337 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:43.126691 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:43.126695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:43.127093 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:43.127274 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.127283 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.128350 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.128358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.129275 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.129288 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.130065 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.130072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.130281 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.130935 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:43.130952 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:43.134445 (+ 3493us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":320,"threads_started":1}
W20260811 01:38:43.134920 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:43.125647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:54009 (local address 127.17.132.62:34663)
0811 01:38:43.125848 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:43.125857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:43.126266 (+ 409us) server_negotiation.cc:407] Connection header received
0811 01:38:43.126464 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:43.126470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:43.126545 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:43.126650 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:43.127429 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.128215 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.129421 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.129912 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.130038 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.134674 (+ 4636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:54009: BlockingRecv error: recv got EOF from 127.17.132.2:54009 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:43.596616 28116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:43.586641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:54061)
0811 01:38:43.587527 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:43.587577 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:43.587766 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:43.588172 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:43.588175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:43.588544 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:43.588720 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.588728 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.589867 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.589871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.590901 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.590914 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.591639 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.591644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.591788 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.592409 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:43.592427 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:43.596278 (+ 3851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":544,"threads_started":1}
W20260811 01:38:43.596877 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:43.586759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:54061 (local address 127.17.132.62:34663)
0811 01:38:43.587110 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:43.587120 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:43.587661 (+ 541us) server_negotiation.cc:407] Connection header received
0811 01:38:43.587908 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:43.587914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:43.587999 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:43.588104 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:43.588871 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.589644 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.591040 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.591460 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.591558 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.596560 (+ 5002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:54061: BlockingRecv error: recv got EOF from 127.17.132.1:54061 (error 108)
Metrics: {"server-negotiator.queue_time_us":186}
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:43 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:43.838786 28117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:43.829304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:60207)
0811 01:38:43.829849 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:43.829866 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:43.830005 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:43.830379 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:43.830382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:43.830759 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:43.830935 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.830943 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.832030 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.832035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.833161 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:43.833176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.833924 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.833929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:43.834151 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.834916 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:43.834934 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:43.838550 (+ 3616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":302,"threads_started":1}
W20260811 01:38:43.839123 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:43.829492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:60207 (local address 127.17.132.62:34663)
0811 01:38:43.829746 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:43.829752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:43.829977 (+ 225us) server_negotiation.cc:407] Connection header received
0811 01:38:43.830141 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:43.830145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:43.830233 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:43.830329 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:43.831109 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.831872 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.833297 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:43.833718 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:43.833913 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:43.838810 (+ 4897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:60207: BlockingRecv error: recv got EOF from 127.17.132.3:60207 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:44.145399 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:44.135921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:45013)
0811 01:38:44.136424 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:44.136440 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:44.136550 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:44.136850 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:44.136853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:44.137248 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:44.137411 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.137419 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.138486 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.138491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.139520 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.139534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.140272 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.140277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.140412 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.141092 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:44.141110 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:44.145028 (+ 3918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":286,"threads_started":1}
W20260811 01:38:44.145622 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:44.136012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:45013 (local address 127.17.132.62:34663)
0811 01:38:44.136275 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:44.136282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:44.136521 (+ 239us) server_negotiation.cc:407] Connection header received
0811 01:38:44.136648 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:44.136652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:44.136716 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:44.136797 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:44.137534 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.138323 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.139663 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.140124 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.140227 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.145321 (+ 5094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:45013: BlockingRecv error: recv got EOF from 127.17.132.2:45013 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:38:44.607604 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:44.597713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:44903 (local address 127.17.132.62:34663)
0811 01:38:44.597975 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:44.597981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:44.598245 (+ 264us) server_negotiation.cc:407] Connection header received
0811 01:38:44.598408 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:44.598411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:44.598508 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:44.598656 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:44.599745 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.600501 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.601728 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.602201 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.602301 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.607427 (+ 5126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:44903: BlockingRecv error: recv got EOF from 127.17.132.1:44903 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 01:38:44.608080 28119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:44.597570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:44903)
0811 01:38:44.598139 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:44.598161 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:44.598286 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:44.598717 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:44.598724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:44.599364 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:44.599594 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.599617 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.600648 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.600652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.601581 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.601594 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.602359 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.602364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.602517 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.603217 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:44.603236 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:44.607828 (+ 4592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":316,"threads_started":1}
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:44 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:44.851641 28120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:44.840195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:35461)
0811 01:38:44.840932 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:44.840953 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:44.841110 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:44.841539 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:44.841543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:44.842096 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:44.842350 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.842366 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.843820 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.843830 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.845195 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:44.845212 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.846000 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.846008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:44.846170 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.846867 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:44.846888 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:44.851245 (+ 4357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":442,"threads_started":1}
W20260811 01:38:44.851694 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:44.840370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:35461 (local address 127.17.132.62:34663)
0811 01:38:44.840565 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:44.840569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:44.841079 (+ 510us) server_negotiation.cc:407] Connection header received
0811 01:38:44.841255 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:44.841259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:44.841345 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:44.841437 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:44.842543 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.843646 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.845356 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:44.845776 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:44.845968 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:44.851473 (+ 5505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:35461: BlockingRecv error: recv got EOF from 127.17.132.3:35461 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:45.156272 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:45.146575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:37265)
0811 01:38:45.147147 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:45.147163 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:45.147283 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:45.147600 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:45.147603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:45.148034 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:45.148197 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.148205 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.149325 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.149329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.150424 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.150438 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.151212 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.151216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.151354 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.152057 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:45.152076 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:45.155934 (+ 3858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":310,"threads_started":1}
W20260811 01:38:45.156512 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:45.146761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:37265 (local address 127.17.132.62:34663)
0811 01:38:45.146951 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:45.146955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:45.147241 (+ 286us) server_negotiation.cc:407] Connection header received
0811 01:38:45.147384 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:45.147387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:45.147451 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:45.147546 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:45.148341 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.149178 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.150593 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.151068 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.151176 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.156246 (+ 5070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:37265: BlockingRecv error: recv got EOF from 127.17.132.2:37265 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:45.619738 28122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:45.609216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:60455)
0811 01:38:45.610014 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:45.610035 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:45.610189 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:45.610626 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:45.610631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:45.611201 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:45.611425 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.611437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.612737 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.612741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.614158 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.614176 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.615138 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.615148 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.615296 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.615903 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:45.615923 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:45.619486 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":550,"threads_started":1}
W20260811 01:38:45.620081 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:45.609475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:60455 (local address 127.17.132.62:34663)
0811 01:38:45.609679 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:45.609684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:45.610129 (+ 445us) server_negotiation.cc:407] Connection header received
0811 01:38:45.610363 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:45.610368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:45.610436 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:45.610565 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:45.611625 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.612528 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.614344 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.614947 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.615053 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.619774 (+ 4721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:60455: BlockingRecv error: recv got EOF from 127.17.132.1:60455 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:45 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:45.862946 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:45.852914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:54933)
0811 01:38:45.853495 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:45.853510 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:45.853644 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:45.854057 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:45.854061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:45.854534 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:45.854693 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.854703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.856206 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.856214 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.857347 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:45.857361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.858234 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.858238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:45.858411 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.859012 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:45.859030 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:45.862685 (+ 3655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":323,"threads_started":1}
W20260811 01:38:45.863283 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:45.852930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54933 (local address 127.17.132.62:34663)
0811 01:38:45.853097 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:45.853102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:45.853587 (+ 485us) server_negotiation.cc:407] Connection header received
0811 01:38:45.853824 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:45.853829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:45.853905 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:45.854019 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:45.854845 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.856037 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.857522 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:45.858089 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:45.858199 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:45.862969 (+ 4770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:54933: BlockingRecv error: recv got EOF from 127.17.132.3:54933 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:46.167577 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:46.157522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:47065)
0811 01:38:46.158158 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:46.158174 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:46.158295 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:46.158622 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:46.158626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:46.159109 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:46.159279 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.159288 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.160408 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.160412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.161401 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.161414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.162311 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.162317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.162464 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.163177 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:46.163196 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:46.167203 (+ 4007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":391,"threads_started":1}
W20260811 01:38:46.167950 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:46.157592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:47065 (local address 127.17.132.62:34663)
0811 01:38:46.157920 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:46.157930 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:46.158292 (+ 362us) server_negotiation.cc:407] Connection header received
0811 01:38:46.158401 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:46.158405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:46.158473 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:46.158557 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:46.159445 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.160226 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.161564 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.162125 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.162230 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.167619 (+ 5389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:47065: BlockingRecv error: recv got EOF from 127.17.132.2:47065 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:46.630785 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:46.620878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:53049)
0811 01:38:46.621575 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:46.621604 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:46.621749 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:46.622173 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:46.622177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:46.622645 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:46.622823 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.622833 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.623887 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.623892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.624881 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.624894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.625661 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.625666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.625853 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.626482 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:46.626500 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:46.630472 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":372,"threads_started":1}
W20260811 01:38:46.630975 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:46.620978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:53049 (local address 127.17.132.62:34663)
0811 01:38:46.621174 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:46.621179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:46.621724 (+ 545us) server_negotiation.cc:407] Connection header received
0811 01:38:46.621923 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:46.621927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:46.621997 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:46.622093 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:46.622981 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.623744 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.625031 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.625501 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.625615 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.630701 (+ 5086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:53049: BlockingRecv error: recv got EOF from 127.17.132.1:53049 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:46 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:46.874495 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:46.864462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:38655)
0811 01:38:46.864953 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:46.864970 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:46.865094 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:46.865430 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:46.865434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:46.865873 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:46.866043 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.866051 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.867204 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.867208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.868307 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:46.868325 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.869028 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.869032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:46.869191 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.869872 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:46.869891 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:46.874147 (+ 4256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":274,"threads_started":1}
W20260811 01:38:46.874792 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:46.864568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:38655 (local address 127.17.132.62:34663)
0811 01:38:46.864820 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:46.864827 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:46.865060 (+ 233us) server_negotiation.cc:407] Connection header received
0811 01:38:46.865223 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:46.865227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:46.865295 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:46.865380 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:46.866265 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.867057 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.868462 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:46.868882 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:46.868980 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:46.874458 (+ 5478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:38655: BlockingRecv error: recv got EOF from 127.17.132.3:38655 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:47.179286 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:47.168824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:36119)
0811 01:38:47.169513 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:47.169531 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:47.169660 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:47.170084 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:47.170088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:47.170645 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:47.170835 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.170845 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.171970 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.171974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.172946 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.172959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.173896 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.173903 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.174074 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.174846 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:47.174865 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:47.178881 (+ 4016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":337,"threads_started":1}
W20260811 01:38:47.179404 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:47.168874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:36119 (local address 127.17.132.62:34663)
0811 01:38:47.169130 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:47.169138 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:47.169620 (+ 482us) server_negotiation.cc:407] Connection header received
0811 01:38:47.169801 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:47.169858 (+ 57us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:47.169945 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:47.170033 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:47.171019 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.171816 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.173092 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.173632 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.173746 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.179141 (+ 5395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:36119: BlockingRecv error: recv got EOF from 127.17.132.2:36119 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:47.641841 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:47.632014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:60037)
0811 01:38:47.632616 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:47.632636 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:47.632810 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:47.633159 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:47.633164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:47.633595 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:47.633774 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.633835 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.634867 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.634875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.635913 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.635925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.636749 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.636755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.636936 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.637578 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:47.637597 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:47.641429 (+ 3832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":321,"threads_started":1}
W20260811 01:38:47.641995 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:47.632126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:60037 (local address 127.17.132.62:34663)
0811 01:38:47.632423 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:47.632431 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:47.632727 (+ 296us) server_negotiation.cc:407] Connection header received
0811 01:38:47.632945 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:47.632952 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:47.633020 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:47.633128 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:47.633982 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.634714 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.636065 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.636547 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.636698 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.641678 (+ 4980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:60037: BlockingRecv error: recv got EOF from 127.17.132.1:60037 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:47 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:47.891235 28130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:47.875812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:44161)
0811 01:38:47.876556 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:47.876573 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:47.877003 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:47.877513 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:47.877517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:47.878119 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:47.878355 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.878366 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.879623 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.879628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.880687 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:47.880703 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.881672 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.881677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:47.881915 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.886891 (+ 4976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:47.886915 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:47.890853 (+ 3938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":351,"threads_started":1}
W20260811 01:38:47.891371 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:47.876022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:44161 (local address 127.17.132.62:34663)
0811 01:38:47.876255 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:47.876259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:47.876752 (+ 493us) server_negotiation.cc:407] Connection header received
0811 01:38:47.877193 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:47.877197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:47.877304 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:47.877409 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:47.878529 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.879431 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.880907 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:47.881460 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:47.881589 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:47.891108 (+ 9519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:44161: BlockingRecv error: recv got EOF from 127.17.132.3:44161 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:48.190475 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:48.180328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:59933)
0811 01:38:48.180941 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:48.180957 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:48.181077 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:48.181539 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:48.181547 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:48.182066 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:48.182251 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.182261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.183522 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.183526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.184499 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.184511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.185354 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.185359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.185478 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.186189 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:48.186209 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:48.190085 (+ 3876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":310,"threads_started":1}
W20260811 01:38:48.190650 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:48.180420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:59933 (local address 127.17.132.62:34663)
0811 01:38:48.180655 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:48.180661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:48.181050 (+ 389us) server_negotiation.cc:407] Connection header received
0811 01:38:48.181265 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:48.181269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:48.181368 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:48.181472 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:48.182400 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.183382 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.184683 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.185159 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.185292 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.190342 (+ 5050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:59933: BlockingRecv error: recv got EOF from 127.17.132.2:59933 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:48.654145 28132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:48.643365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:41665)
0811 01:38:48.643959 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:48.643986 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:48.644126 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:48.644553 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:48.644557 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:48.645030 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:48.645193 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.645204 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.646430 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.646435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.647423 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.647438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.648270 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.648274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.648414 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.649082 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:48.649101 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:48.653871 (+ 4770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":325,"threads_started":1}
W20260811 01:38:48.654440 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:48.643486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:41665 (local address 127.17.132.62:34663)
0811 01:38:48.643797 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:48.643803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:48.644096 (+ 293us) server_negotiation.cc:407] Connection header received
0811 01:38:48.644304 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:48.644308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:48.644379 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:48.644473 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:48.645395 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.646280 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.647602 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.648105 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.648212 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.654177 (+ 5965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:41665: BlockingRecv error: recv got EOF from 127.17.132.1:41665 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:48 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:48.902302 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:48.892542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:60283)
0811 01:38:48.893158 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:48.893179 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:48.893326 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:48.893709 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:48.893713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:48.894371 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:48.894552 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.894562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.895607 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.895610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.896590 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:48.896600 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.897349 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.897354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:48.897473 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.898229 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:48.898247 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:48.902007 (+ 3760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":532,"threads_started":1}
W20260811 01:38:48.902509 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:48.892847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:60283 (local address 127.17.132.62:34663)
0811 01:38:48.893072 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:48.893079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:48.893278 (+ 199us) server_negotiation.cc:407] Connection header received
0811 01:38:48.893456 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:48.893463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:48.893541 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:48.893667 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:48.894692 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.895456 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.896728 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:48.897157 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:48.897258 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:48.902247 (+ 4989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:60283: BlockingRecv error: recv got EOF from 127.17.132.3:60283 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:49.201289 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:49.191701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:35363)
0811 01:38:49.192314 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:49.192331 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:49.192449 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:49.192858 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:49.192862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:49.193335 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:49.193500 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.193510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.194587 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.194591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.195554 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.195566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.196300 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.196305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.196430 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.197018 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:49.197035 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:49.201028 (+ 3993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":308,"threads_started":1}
W20260811 01:38:49.201431 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:49.191825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:35363 (local address 127.17.132.62:34663)
0811 01:38:49.192001 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:49.192006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:49.192410 (+ 404us) server_negotiation.cc:407] Connection header received
0811 01:38:49.192580 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:49.192584 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:49.192655 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:49.192748 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:49.193651 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.194446 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.195681 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.196123 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.196223 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.201214 (+ 4991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:35363: BlockingRecv error: recv got EOF from 127.17.132.2:35363 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:49.664882 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:49.655302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:57769)
0811 01:38:49.655817 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:49.655838 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:49.655968 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:49.656335 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:49.656339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:49.656754 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:49.656959 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.656970 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.658089 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.658093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.659128 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.659142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.659842 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.659846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.659965 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.660624 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:49.660642 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:49.664500 (+ 3858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":276,"threads_started":1}
W20260811 01:38:49.665004 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:49.655381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:57769 (local address 127.17.132.62:34663)
0811 01:38:49.655628 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:49.655635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:49.655923 (+ 288us) server_negotiation.cc:407] Connection header received
0811 01:38:49.656085 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:49.656089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:49.656163 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:49.656247 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:49.657135 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.657914 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.659269 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.659688 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.659803 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.664736 (+ 4933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:57769: BlockingRecv error: recv got EOF from 127.17.132.1:57769 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:49 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:49.913548 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:49.903549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:39021)
0811 01:38:49.904161 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:49.904177 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:49.904355 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:49.904873 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:49.904880 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:49.905585 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:49.905852 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.905869 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.907193 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.907197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.908182 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:49.908195 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.908871 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.908876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:49.909012 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.909725 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:49.909745 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:49.913297 (+ 3552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":291,"threads_started":1}
W20260811 01:38:49.913779 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:49.903715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:39021 (local address 127.17.132.62:34663)
0811 01:38:49.903982 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:49.903990 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:49.904287 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:38:49.904494 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:49.904498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:49.904594 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:49.904727 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:49.906053 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.907041 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.908312 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:49.908720 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:49.908814 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:49.913530 (+ 4716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:39021: BlockingRecv error: recv got EOF from 127.17.132.3:39021 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:50.212498 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:50.202369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:45011)
0811 01:38:50.203074 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:50.203091 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:50.203206 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:50.203567 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:50.203571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:50.203983 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:50.204148 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.204158 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.205331 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.205336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.206457 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.206471 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.207310 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.207315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.207453 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.208177 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:50.208197 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:50.212220 (+ 4023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":434,"threads_started":1}
W20260811 01:38:50.212781 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:50.202447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:45011 (local address 127.17.132.62:34663)
0811 01:38:50.202635 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:50.202639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:50.203174 (+ 535us) server_negotiation.cc:407] Connection header received
0811 01:38:50.203305 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:50.203310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:50.203409 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:50.203492 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:50.204313 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.205129 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.206626 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.207119 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.207233 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.212466 (+ 5233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:45011: BlockingRecv error: recv got EOF from 127.17.132.2:45011 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:50.676020 28138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:50.666141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:45613)
0811 01:38:50.666829 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:50.666852 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:50.667023 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:50.667404 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:50.667409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:50.667877 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:50.668071 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.668080 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.669098 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.669103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.670241 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.670258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.671109 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.671116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.671319 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.672054 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:50.672075 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:50.675664 (+ 3589us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":358,"threads_started":1}
W20260811 01:38:50.676151 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:50.666394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:45613 (local address 127.17.132.62:34663)
0811 01:38:50.666727 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:50.666733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:50.666938 (+ 205us) server_negotiation.cc:407] Connection header received
0811 01:38:50.667167 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:50.667173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:50.667251 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:50.667360 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:50.668225 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.668946 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.670417 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.670917 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.671068 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.675889 (+ 4821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:45613: BlockingRecv error: recv got EOF from 127.17.132.1:45613 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:50 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:50.924973 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:50.914643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:49813)
0811 01:38:50.915161 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:50.915178 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:50.915302 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:50.915700 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:50.915704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:50.916207 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:50.916383 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.916393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.917596 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.917600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.918676 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:50.918690 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.919441 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.919446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:50.919583 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.920334 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:50.920356 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:50.924621 (+ 4265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":272,"threads_started":1}
W20260811 01:38:50.925150 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:50.914731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:49813 (local address 127.17.132.62:34663)
0811 01:38:50.914975 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:50.914982 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:50.915262 (+ 280us) server_negotiation.cc:407] Connection header received
0811 01:38:50.915408 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:50.915412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:50.915497 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:50.915598 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:50.916579 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.917425 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.918816 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:50.919298 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:50.919395 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:50.924862 (+ 5467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:49813: BlockingRecv error: recv got EOF from 127.17.132.3:49813 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:51.223176 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:51.213764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:38761)
0811 01:38:51.214354 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:51.214370 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:51.214484 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:51.214845 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:51.214848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:51.215268 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:51.215445 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.215453 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.216508 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.216512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.217444 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.217455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.218247 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.218251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.218383 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.218990 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:51.219008 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:51.222901 (+ 3893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":304,"threads_started":1}
W20260811 01:38:51.223358 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:51.213907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:38761 (local address 127.17.132.62:34663)
0811 01:38:51.214121 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:51.214129 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:51.214452 (+ 323us) server_negotiation.cc:407] Connection header received
0811 01:38:51.214601 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:51.214605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:51.214712 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:51.214798 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:51.215609 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.216378 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.217584 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.218116 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.218223 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.223123 (+ 4900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:38761: BlockingRecv error: recv got EOF from 127.17.132.2:38761 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:51.687320 28142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:51.677329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:55119)
0811 01:38:51.677984 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:51.678011 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:51.678187 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:51.678547 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:51.678552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:51.679027 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:51.679227 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.679236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.680516 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.680521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.681628 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.681642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.682512 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.682519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.682711 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.683369 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:51.683388 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:51.687059 (+ 3671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":307,"threads_started":1}
W20260811 01:38:51.687582 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:51.677417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:55119 (local address 127.17.132.62:34663)
0811 01:38:51.677668 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:51.677677 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:51.678102 (+ 425us) server_negotiation.cc:407] Connection header received
0811 01:38:51.678335 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:51.678339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:51.678406 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:51.678514 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:51.679377 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.680381 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.681808 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.682307 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.682456 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.687293 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:55119: BlockingRecv error: recv got EOF from 127.17.132.1:55119 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:51 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:51.935690 28143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:51.926003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:45045)
0811 01:38:51.926596 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:51.926613 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:51.926732 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:51.927077 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:51.927080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:51.927555 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:51.927743 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.927753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.928738 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.928742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.929666 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:51.929678 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.930515 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.930520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:51.930670 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.931336 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:51.931356 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:51.935304 (+ 3948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":324,"threads_started":1}
W20260811 01:38:51.935783 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:51.926074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:45045 (local address 127.17.132.62:34663)
0811 01:38:51.926250 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:51.926255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:51.926688 (+ 433us) server_negotiation.cc:407] Connection header received
0811 01:38:51.926831 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:51.926835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:51.926899 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:51.926986 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:51.927886 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.928619 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.929868 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:51.930330 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:51.930435 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:51.935517 (+ 5082us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:45045: BlockingRecv error: recv got EOF from 127.17.132.3:45045 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:52.234264 28144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:52.224319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:44235)
0811 01:38:52.224902 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:52.224919 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:52.225081 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:52.225467 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:52.225472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:52.225999 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:52.226187 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.226197 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.227276 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.227283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.228240 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.228252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.229060 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.229066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.229267 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.229993 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:52.230023 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:52.233858 (+ 3835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":328,"threads_started":1}
W20260811 01:38:52.234543 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:52.224508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:44235 (local address 127.17.132.62:34663)
0811 01:38:52.224699 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:52.224703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:52.225011 (+ 308us) server_negotiation.cc:407] Connection header received
0811 01:38:52.225222 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:52.225226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:52.225306 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:52.225415 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:52.226350 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.227120 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.228391 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.228866 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.229010 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.234101 (+ 5091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:44235: BlockingRecv error: recv got EOF from 127.17.132.2:44235 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:52.697855 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:52.688442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:33897)
0811 01:38:52.689039 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:52.689059 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:52.689232 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:52.689600 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:52.689604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:52.690111 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:52.690287 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.690296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.691309 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.691315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.692230 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.692241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.692984 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.692990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.693196 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.693879 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:52.693898 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:52.697492 (+ 3594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":357,"threads_started":1}
W20260811 01:38:52.698014 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:52.688617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:33897 (local address 127.17.132.62:34663)
0811 01:38:52.688895 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:52.688903 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:52.689146 (+ 243us) server_negotiation.cc:407] Connection header received
0811 01:38:52.689386 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:52.689390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:52.689454 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:52.689557 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:52.690433 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.691165 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.692383 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.692838 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.692971 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.697727 (+ 4756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:33897: BlockingRecv error: recv got EOF from 127.17.132.1:33897 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:52 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:52.950584 28146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:52.936731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:34373)
0811 01:38:52.937389 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:52.937407 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:52.937529 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:52.937950 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:52.937954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:52.938393 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:52.938576 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.938584 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.939697 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.939700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.940669 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:52.940681 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.941399 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.941403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:52.941534 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.946213 (+ 4679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:52.946233 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:52.950270 (+ 4037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":386,"threads_started":1}
W20260811 01:38:52.950807 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:52.936861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:34373 (local address 127.17.132.62:34663)
0811 01:38:52.937047 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:52.937052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:52.937484 (+ 432us) server_negotiation.cc:407] Connection header received
0811 01:38:52.937686 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:52.937691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:52.937761 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:52.937874 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:52.938742 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.939549 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.940806 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:52.941236 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:52.941338 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:52.950528 (+ 9190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:34373: BlockingRecv error: recv got EOF from 127.17.132.3:34373 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:53.244560 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:53.235304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:45429)
0811 01:38:53.235814 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:53.235830 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:53.235944 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:53.236264 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:53.236268 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:53.236695 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:53.236857 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.236866 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.237929 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.237933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.238856 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.238868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.239561 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.239566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.239690 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.240297 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:53.240315 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:53.244333 (+ 4018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":294,"threads_started":1}
W20260811 01:38:53.244858 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:53.235579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:45429 (local address 127.17.132.62:34663)
0811 01:38:53.235778 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:53.235782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:53.235903 (+ 121us) server_negotiation.cc:407] Connection header received
0811 01:38:53.236042 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:53.236046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:53.236128 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:53.236216 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:53.236990 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.237738 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.238987 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.239422 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.239521 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.244604 (+ 5083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:45429: BlockingRecv error: recv got EOF from 127.17.132.2:45429 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.1@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:53.710093 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:53.699228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.1:35919)
0811 01:38:53.699778 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:53.699798 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:53.699916 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:53.700239 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:53.700242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:53.700645 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:53.700841 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.700850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.702107 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.702113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.703627 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.703643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.704728 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.704735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.704923 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.705576 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:53.705598 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:53.709654 (+ 4056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":276,"threads_started":1}
W20260811 01:38:53.710232 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:53.699303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:35919 (local address 127.17.132.62:34663)
0811 01:38:53.699493 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:53.699497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:53.699871 (+ 374us) server_negotiation.cc:407] Connection header received
0811 01:38:53.700017 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:53.700021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:53.700083 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:53.700187 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:53.701028 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.701943 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.703777 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.704582 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.704693 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.709930 (+ 5237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.1:35919: BlockingRecv error: recv got EOF from 127.17.132.1:35919 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:53 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.3@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:53.961308 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:53.951703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.3:59749)
0811 01:38:53.952347 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:53.952363 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:53.952482 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:53.952908 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:53.952915 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:53.953479 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:53.953638 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.953648 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.954799 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.954806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.955827 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:53.955839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.956521 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.956525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:53.956662 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.957335 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:53.957353 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:53.961062 (+ 3709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":400,"threads_started":1}
W20260811 01:38:53.961483 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:53.951884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:59749 (local address 127.17.132.62:34663)
0811 01:38:53.952139 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:53.952148 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:53.952452 (+ 304us) server_negotiation.cc:407] Connection header received
0811 01:38:53.952643 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:53.952647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:53.952731 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:53.952834 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:53.953838 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.954646 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.955972 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:53.956380 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:53.956477 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:53.961254 (+ 4777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.3:59749: BlockingRecv error: recv got EOF from 127.17.132.3:59749 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 11 01:38:54 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:38:54 dist-test-slave-0kls krb5kdc[26970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.132.2@KRBTEST.COM for oryx/127.17.132.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:38:54.255748 28150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:54.245914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34663 (local address 127.17.132.2:54193)
0811 01:38:54.246468 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:54.246484 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:54.246598 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:54.246974 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:54.246978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:54.247381 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:54.247577 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:54.247586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.248586 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.248590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:54.249549 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:54.249563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.250444 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.250450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:54.250596 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:54.251415 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:38:54.251440 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:54.255484 (+ 4044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.132.62:34663: Server oryx/127.17.132.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":293,"threads_started":1}
W20260811 01:38:54.255957 28102 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:54.246002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:54193 (local address 127.17.132.62:34663)
0811 01:38:54.246197 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:54.246201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:54.246556 (+ 355us) server_negotiation.cc:407] Connection header received
0811 01:38:54.246699 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:54.246703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:54.246788 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:54.246880 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:54.247721 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.248441 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.249689 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.250272 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.250371 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:54.255698 (+ 5327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.132.2:54193: BlockingRecv error: recv got EOF from 127.17.132.2:54193 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:38:54.622965 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27637
I20260811 01:38:54.635900 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:54.624145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.17.132.1:42903)
0811 01:38:54.624803 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:54.624811 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:54.624839 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:38:54.624907 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:54.624914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:54.625154 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:54.625335 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:54.626813 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.627829 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.629004 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.629570 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.629680 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:54.632336 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:54.632344 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:54.632359 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:54.632411 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:54.635372 (+ 2961us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:38:54.635673 (+ 301us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52938: Request ticket server kudu/127.17.132.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":324,"threads_started":1}
W20260811 01:38:54.636025 28152 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52938: Request ticket server kudu/127.17.132.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:38:54.636152 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27637: Not authorized: Client connection negotiation failed: client connection to 127.17.132.1:42903: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:38:54.636368 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27637
I20260811 01:38:54.657984 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27800
I20260811 01:38:54.671814 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:54.659345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42794 (local address 127.17.132.2:37451)
0811 01:38:54.660128 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:54.660142 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:54.660173 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:38:54.660244 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:54.660251 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:54.660505 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:54.660671 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:54.662742 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.663863 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.665086 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.665701 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.665873 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:54.668502 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:54.668511 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:54.668525 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:54.668562 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:54.671221 (+ 2659us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:38:54.671525 (+ 304us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42794: Request ticket server kudu/127.17.132.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":430,"threads_started":1}
W20260811 01:38:54.671914 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27800: Not authorized: Client connection negotiation failed: client connection to 127.17.132.2:37451: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:38:54.672030 28153 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42794: Request ticket server kudu/127.17.132.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:38:54.672129 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27800
I20260811 01:38:54.695106 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27947
I20260811 01:38:54.709775 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:54.696263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.17.132.3:37757)
0811 01:38:54.696899 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:54.696909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:54.696941 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:38:54.697023 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:54.697032 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:54.697364 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:54.697582 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:54.699027 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.700493 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.701942 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:54.702891 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:54.703028 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:54.705728 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:54.705738 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:54.705755 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:38:54.705881 (+ 126us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:54.708920 (+ 3039us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:38:54.709400 (+ 480us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35824: Request ticket server kudu/127.17.132.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":289,"threads_started":1}
W20260811 01:38:54.709890 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27947: Not authorized: Client connection negotiation failed: client connection to 127.17.132.3:37757: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.132.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:38:54.709945 28154 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35824: Request ticket server kudu/127.17.132.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:38:54.710057 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27947
I20260811 01:38:54.731632 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 27557
I20260811 01:38:54.733173 27628 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:54.853607 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 27557
2026-08-11T01:38:54Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22124 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T01:38:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:54Z Disabled control of system clock
I20260811 01:38:54.948312 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43837
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:36501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:38:55.304184 28159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:55.304534 28159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:55.304670 28159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:55.312429 28159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:55.312563 28159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:55.312661 28159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:55.312767 28159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:55.312844 28159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:55.323017 28159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43837
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:55.324486 28159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:55.326527 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:55.340936 28167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:55.341017 28159 server_base.cc:1034] running on GCE node
W20260811 01:38:55.341008 28169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:55.341763 28166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:55.342793 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:55.344359 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:55.345613 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786412335345566 us; error 40 us; skew 500 ppm
I20260811 01:38:55.346103 28159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:55.349267 28159 webserver.cc:460] Webserver started at http://127.17.132.62:46029/ using document root <none> and password file <none>
I20260811 01:38:55.350224 28159 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:55.350373 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:55.350744 28159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:55.354133 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "a3383434da7c4320986e42a074a8fb22"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "1af84482418536721fee7995ebf8fae3"
server_key_iv: "24d0f46dff54fb45b487063f48e8aad3"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.355086 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "a3383434da7c4320986e42a074a8fb22"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "1af84482418536721fee7995ebf8fae3"
server_key_iv: "24d0f46dff54fb45b487063f48e8aad3"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.360742 28159 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:55.364768 28176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:55.366540 28159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:55.366765 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "a3383434da7c4320986e42a074a8fb22"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "1af84482418536721fee7995ebf8fae3"
server_key_iv: "24d0f46dff54fb45b487063f48e8aad3"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.367024 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:55.392531 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:55.393462 28159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:55.393818 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:55.412788 28159 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:43837
I20260811 01:38:55.412814 28233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:43837 every 8 connection(s)
I20260811 01:38:55.414295 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:55.417631 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28159
I20260811 01:38:55.417900 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:55.418588 17936 external_mini_cluster.cc:1428] Setting key 30d26ea86baf1c5835c453bfc1d2d0c9
I20260811 01:38:55.418637 28234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:55.432206 28234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22: Bootstrap starting.
I20260811 01:38:55.434047 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:55.421012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44670 (local address 127.17.132.62:43837)
0811 01:38:55.422453 (+ 1441us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:55.422469 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:55.422530 (+ 61us) server_negotiation.cc:407] Connection header received
0811 01:38:55.424873 (+ 2343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:55.424900 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:55.425427 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:55.425998 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:55.426599 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:55.427865 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:55.429228 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:55.430050 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:55.430295 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:55.431561 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:55.431569 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:55.431587 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:55.432149 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:55.432233 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:55.432255 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:55.432391 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:55.432617 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 01:38:55.432942 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":495,"threads_started":1}
I20260811 01:38:55.436189 28234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:55.437538 28234 log.cc:824] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:55.440778 28234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22: No bootstrap required, opened a new log
I20260811 01:38:55.449314 28234 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } }
I20260811 01:38:55.449939 28234 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:55.450096 28234 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3383434da7c4320986e42a074a8fb22, State: Initialized, Role: FOLLOWER
I20260811 01:38:55.450773 28234 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } }
I20260811 01:38:55.451061 28234 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:55.451231 28234 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:55.451416 28234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:55.453928 28234 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } }
I20260811 01:38:55.454531 28234 leader_election.cc:302] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3383434da7c4320986e42a074a8fb22; no voters:
I20260811 01:38:55.455340 28234 leader_election.cc:288] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:55.455484 28240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:55.457365 28240 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [term 1 LEADER]: Becoming Leader. State: Replica: a3383434da7c4320986e42a074a8fb22, State: Running, Role: LEADER
I20260811 01:38:55.457944 28234 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:55.458010 28240 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } }
I20260811 01:38:55.461078 28242 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3383434da7c4320986e42a074a8fb22. Latest consensus state: current_term: 1 leader_uuid: "a3383434da7c4320986e42a074a8fb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } } }
I20260811 01:38:55.461503 28242 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:55.462168 28241 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3383434da7c4320986e42a074a8fb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3383434da7c4320986e42a074a8fb22" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43837 } } }
I20260811 01:38:55.462567 28241 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22 [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:55.462687 28250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:55.473574 28250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:55.485810 28250 catalog_manager.cc:1347] Generated new cluster ID: 3fcfca95b5394e84844de405beed5b33
I20260811 01:38:55.485948 28250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:55.510252 28250 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:55.512217 28250 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:55.529235 28250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3383434da7c4320986e42a074a8fb22: Generated new TSK 0
I20260811 01:38:55.530385 28250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:55.551275 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--builtin_ntp_servers=127.17.132.20:36501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 01:38:55.919862 28264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:55.920161 28264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:55.920248 28264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:55.927663 28264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:55.927783 28264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:55.927891 28264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:55.937413 28264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:55.938804 28264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:55.940686 28264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:55.954126 28269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:55.954077 28270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:55.954159 28272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:55.954873 28264 server_base.cc:1034] running on GCE node
I20260811 01:38:55.955493 28264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:55.956507 28264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:55.957702 28264 hybrid_clock.cc:648] HybridClock initialized: now 1786412335957637 us; error 57 us; skew 500 ppm
I20260811 01:38:55.958076 28264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:55.960747 28264 webserver.cc:460] Webserver started at http://127.17.132.1:45647/ using document root <none> and password file <none>
I20260811 01:38:55.961490 28264 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:55.961587 28264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:55.962003 28264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:55.964955 28264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "37c671aec821476b8a40cebfa118b1d5"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "af412da55d77d6314501c823e34ebc19"
server_key_iv: "0f849062db303f8fcddcad12f359a041"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.965832 28264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "37c671aec821476b8a40cebfa118b1d5"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "af412da55d77d6314501c823e34ebc19"
server_key_iv: "0f849062db303f8fcddcad12f359a041"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.971779 28264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 01:38:55.975564 28279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:55.977023 28264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:38:55.977270 28264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "37c671aec821476b8a40cebfa118b1d5"
format_stamp: "Formatted at 2026-08-11 01:38:55 on dist-test-slave-0kls"
server_key: "af412da55d77d6314501c823e34ebc19"
server_key_iv: "0f849062db303f8fcddcad12f359a041"
server_key_version: "encryptionkey@0"
I20260811 01:38:55.977519 28264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:56.020555 28264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:56.021507 28264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:56.021899 28264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:56.022986 28264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:56.024516 28264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:56.024628 28264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:56.024763 28264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:56.024843 28264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:56.060001 28264 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42679
I20260811 01:38:56.060063 28403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42679 every 8 connection(s)
I20260811 01:38:56.061409 28264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:56.062808 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28264
I20260811 01:38:56.063045 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:56.063922 17936 external_mini_cluster.cc:1428] Setting key 856b078f775dfc1b6f2be209c9649633
I20260811 01:38:56.066839 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--builtin_ntp_servers=127.17.132.20:36501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 01:38:56.076187 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:56.064416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:52983 (local address 127.17.132.62:43837)
0811 01:38:56.064939 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:56.064943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:56.067126 (+ 2183us) server_negotiation.cc:407] Connection header received
0811 01:38:56.068427 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:56.068436 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:56.068537 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:56.068668 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:56.069851 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.070995 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.072802 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.073528 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.073688 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:56.075161 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:56.075169 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:56.075176 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:56.075206 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:56.075263 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:56.075283 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:56.075378 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:56.075597 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 01:38:56.075719 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":265,"threads_started":1}
I20260811 01:38:56.077095 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:56.065163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43837 (local address 127.17.132.1:52983)
0811 01:38:56.066311 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:56.066359 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:56.068125 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:56.068888 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:56.068898 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:56.069000 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:56.069633 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:56.069651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.071169 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.071173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:56.072639 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:56.072653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.073776 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.073825 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:56.074056 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:56.074803 (+ 747us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:56.074806 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:56.074850 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:56.074945 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:56.075391 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:56.075399 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:56.075405 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:38:56.075553 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 01:38:56.075889 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":355,"threads_started":1}
I20260811 01:38:56.078975 28404 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43837
I20260811 01:38:56.079339 28404 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:56.080183 28404 heartbeater.cc:511] Master 127.17.132.62:43837 requested a full tablet report, sending...
I20260811 01:38:56.082522 28196 ts_manager.cc:194] Registered new tserver with Master: 37c671aec821476b8a40cebfa118b1d5 (127.17.132.1:42679)
I20260811 01:38:56.084039 28196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.1:52983
W20260811 01:38:56.421042 28409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:56.421394 28409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:56.421558 28409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:56.429050 28409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:56.429214 28409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:56.429399 28409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:56.439098 28409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:56.440505 28409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:56.442456 28409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:56.456264 28415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:56.456207 28416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:56.456230 28418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:56.457449 28409 server_base.cc:1034] running on GCE node
I20260811 01:38:56.458205 28409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:56.459298 28409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:56.460525 28409 hybrid_clock.cc:648] HybridClock initialized: now 1786412336460466 us; error 51 us; skew 500 ppm
I20260811 01:38:56.460882 28409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:56.466996 28409 webserver.cc:460] Webserver started at http://127.17.132.2:34205/ using document root <none> and password file <none>
I20260811 01:38:56.467772 28409 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:56.467908 28409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:56.468254 28409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:56.471424 28409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "2081fd865a934907b213cf0b812d0580"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "f7916cb733ce861cce988bf0ad06a06e"
server_key_iv: "3fc0a24fa8af9d03034a2f87b3c5211b"
server_key_version: "encryptionkey@0"
I20260811 01:38:56.472301 28409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "2081fd865a934907b213cf0b812d0580"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "f7916cb733ce861cce988bf0ad06a06e"
server_key_iv: "3fc0a24fa8af9d03034a2f87b3c5211b"
server_key_version: "encryptionkey@0"
I20260811 01:38:56.477859 28409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:38:56.481407 28425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:56.482923 28409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:56.483098 28409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "2081fd865a934907b213cf0b812d0580"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "f7916cb733ce861cce988bf0ad06a06e"
server_key_iv: "3fc0a24fa8af9d03034a2f87b3c5211b"
server_key_version: "encryptionkey@0"
I20260811 01:38:56.483379 28409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:56.522768 28409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:56.523713 28409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:56.524044 28409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:56.525098 28409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:56.526700 28409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:56.526791 28409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:56.526921 28409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:56.527014 28409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:56.561260 28409 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:40257
I20260811 01:38:56.561386 28545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:40257 every 8 connection(s)
I20260811 01:38:56.562803 28409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:56.568920 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28409
I20260811 01:38:56.569142 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:56.569720 17936 external_mini_cluster.cc:1428] Setting key ddbb469d19e4ac36e4b2a1da872c8a44
I20260811 01:38:56.574581 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--builtin_ntp_servers=127.17.132.20:36501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 01:38:56.580032 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:56.565866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:56897 (local address 127.17.132.62:43837)
0811 01:38:56.566054 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:56.566059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:56.567377 (+ 1318us) server_negotiation.cc:407] Connection header received
0811 01:38:56.569623 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:56.569628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:56.569705 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:56.569898 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:56.571340 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.572643 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.575416 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.576246 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.576402 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:56.578638 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:56.578650 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:56.578656 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:56.578711 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:56.578762 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:56.578812 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:56.578951 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:56.579292 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 01:38:56.579464 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:38:56.581619 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:56.566274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43837 (local address 127.17.132.2:56897)
0811 01:38:56.567225 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:56.567262 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:56.569255 (+ 1993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:56.570156 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:56.570167 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:56.570299 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:56.571115 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:56.571145 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.572877 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.572883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:56.575231 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:56.575249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:56.576724 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:56.576733 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:56.577111 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:56.578100 (+ 989us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:56.578105 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:56.578170 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:56.578296 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:56.578952 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:56.578966 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:56.578977 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:38:56.579197 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 01:38:56.579688 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":284,"threads_started":1}
I20260811 01:38:56.583927 28546 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43837
I20260811 01:38:56.584300 28546 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:56.585165 28546 heartbeater.cc:511] Master 127.17.132.62:43837 requested a full tablet report, sending...
I20260811 01:38:56.587025 28196 ts_manager.cc:194] Registered new tserver with Master: 2081fd865a934907b213cf0b812d0580 (127.17.132.2:40257)
I20260811 01:38:56.588336 28196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.2:56897
W20260811 01:38:56.942595 28549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:56.942896 28549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:56.942983 28549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:56.950748 28549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:56.950843 28549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:56.950954 28549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:56.960481 28549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:36501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:43837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:56.961984 28549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:56.963836 28549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:56.978261 28559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:56.978222 28556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:56.978314 28557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:56.984467 28549 server_base.cc:1034] running on GCE node
I20260811 01:38:56.985266 28549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:56.986678 28549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:56.987953 28549 hybrid_clock.cc:648] HybridClock initialized: now 1786412336987902 us; error 39 us; skew 500 ppm
I20260811 01:38:56.988348 28549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:56.991106 28549 webserver.cc:460] Webserver started at http://127.17.132.3:34553/ using document root <none> and password file <none>
I20260811 01:38:56.991858 28549 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:56.992012 28549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:56.992381 28549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:56.995519 28549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "c7ca5367092040ea92433c52d7ef4ae7"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "53f0a30ab9a28ad2330017dd93566d44"
server_key_iv: "de76916422046c5990af56833a4d5df0"
server_key_version: "encryptionkey@0"
I20260811 01:38:56.996411 28549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "c7ca5367092040ea92433c52d7ef4ae7"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "53f0a30ab9a28ad2330017dd93566d44"
server_key_iv: "de76916422046c5990af56833a4d5df0"
server_key_version: "encryptionkey@0"
I20260811 01:38:57.002362 28549 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 01:38:57.006135 28565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:57.007652 28549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:57.007870 28549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "c7ca5367092040ea92433c52d7ef4ae7"
format_stamp: "Formatted at 2026-08-11 01:38:56 on dist-test-slave-0kls"
server_key: "53f0a30ab9a28ad2330017dd93566d44"
server_key_iv: "de76916422046c5990af56833a4d5df0"
server_key_version: "encryptionkey@0"
I20260811 01:38:57.008113 28549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:57.038527 28549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:57.039573 28549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:57.039940 28549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:57.041050 28549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:57.042788 28549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:57.042917 28549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:57.043048 28549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:57.043148 28549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:57.079172 28549 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:33767
I20260811 01:38:57.079265 28686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:33767 every 8 connection(s)
I20260811 01:38:57.080528 28549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:57.083349 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28549
I20260811 01:38:57.083571 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:57.084035 17936 external_mini_cluster.cc:1428] Setting key 79da89209388a0f8192a3df7b97c476e
I20260811 01:38:57.087206 28404 heartbeater.cc:503] Master 127.17.132.62:43837 was elected leader, sending a full tablet report...
I20260811 01:38:57.093497 28689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:57.083241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:51229 (local address 127.17.132.62:43837)
0811 01:38:57.083772 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:57.083779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:57.085087 (+ 1308us) server_negotiation.cc:407] Connection header received
0811 01:38:57.086880 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:57.086886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:57.086974 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:57.087087 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:57.088320 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.089068 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.090731 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.091135 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.091275 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:57.092603 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:57.092607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:57.092611 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:57.092629 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:57.092676 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:57.092687 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:57.092782 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:57.093015 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 01:38:57.093120 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":241,"threads_started":1}
I20260811 01:38:57.094578 28691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:57.083891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43837 (local address 127.17.132.3:51229)
0811 01:38:57.084936 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:57.084981 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:57.086654 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:57.087374 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:57.087385 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:57.087493 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:57.088149 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:57.088166 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.089245 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.089248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:57.090577 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:38:57.090589 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.091366 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.091375 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:38:57.091615 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:57.092282 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:57.092284 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:57.092324 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:57.092402 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:57.092785 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:57.092799 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:57.092807 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:38:57.092993 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 01:38:57.093408 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":356,"threads_started":1}
I20260811 01:38:57.095880 28687 heartbeater.cc:347] Connected to a master server at 127.17.132.62:43837
I20260811 01:38:57.096204 28687 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:57.097007 28687 heartbeater.cc:511] Master 127.17.132.62:43837 requested a full tablet report, sending...
I20260811 01:38:57.098592 28196 ts_manager.cc:194] Registered new tserver with Master: c7ca5367092040ea92433c52d7ef4ae7 (127.17.132.3:33767)
I20260811 01:38:57.099475 28196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.3:51229
I20260811 01:38:57.100483 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:38:57.107350 28689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:57.105642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44676 (local address 127.17.132.62:43837)
0811 01:38:57.105892 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:57.105902 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:57.106353 (+ 451us) server_negotiation.cc:407] Connection header received
0811 01:38:57.106476 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:57.106480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:57.106548 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:57.106641 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:57.107116 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44676: BlockingRecv error: recv got EOF from 127.0.0.1:44676 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:38:57.108397 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28264
I20260811 01:38:57.117369 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:57.109514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59072 (local address 127.17.132.1:42679)
0811 01:38:57.110224 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:57.110231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:57.110259 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:38:57.110322 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:57.110328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:57.110549 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:57.110683 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:57.111101 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.112171 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.113638 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.114422 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.114571 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:57.115790 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:57.115799 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:57.115815 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:57.116456 (+ 641us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:57.116507 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:57.116529 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:57.116631 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:57.116793 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 01:38:57.116920 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":362,"threads_started":1}
I20260811 01:38:57.118806 28397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:57.202963 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28264
I20260811 01:38:57.223572 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28409
I20260811 01:38:57.232599 28703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:57.224709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.17.132.2:40257)
0811 01:38:57.225271 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:57.225279 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:57.225310 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:38:57.225378 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:57.225385 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:57.225633 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:57.226000 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:57.226515 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.227598 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.228969 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.229593 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.229755 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:57.230946 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:57.230955 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:57.230970 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:57.231637 (+ 667us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:57.231690 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:57.231713 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:57.231862 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:57.232030 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 01:38:57.232180 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":268,"threads_started":1}
I20260811 01:38:57.234061 28541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:57.319684 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28409
I20260811 01:38:57.343756 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28549
I20260811 01:38:57.352847 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:57.344867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.17.132.3:33767)
0811 01:38:57.345688 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:57.345695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:57.345728 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:38:57.345863 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:57.345873 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:57.346140 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:57.346333 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:57.346825 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.347914 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.349183 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:38:57.349907 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:38:57.350052 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:38:57.351213 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:57.351222 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:57.351236 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:57.351900 (+ 664us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:57.351949 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:57.351984 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:57.352166 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:57.352315 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 01:38:57.352465 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":501,"threads_started":1}
I20260811 01:38:57.354274 28682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:57.442658 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28549
I20260811 01:38:57.463045 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28159
I20260811 01:38:57.464442 28229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:57.569178 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28159
2026-08-11T01:38:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2710 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T01:38:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:38:57Z Disabled control of system clock
I20260811 01:38:57.661985 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36305
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:38:58.016556 28712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:58.016865 28712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:58.017035 28712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:58.024508 28712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:38:58.024627 28712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:58.024720 28712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:58.024818 28712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:38:58.024893 28712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:38:58.034474 28712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:58.035883 28712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:58.037766 28712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:58.050028 28719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:58.050209 28717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:58.050271 28721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:58.051321 28712 server_base.cc:1034] running on GCE node
I20260811 01:38:58.052136 28712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:58.053516 28712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:58.054739 28712 hybrid_clock.cc:648] HybridClock initialized: now 1786412338054676 us; error 49 us; skew 500 ppm
I20260811 01:38:58.055109 28712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:58.062054 28712 webserver.cc:460] Webserver started at http://127.17.132.62:40601/ using document root <none> and password file <none>
I20260811 01:38:58.062880 28712 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:58.063005 28712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:58.063378 28712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:58.066581 28712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e1f4f0302ed840bcaf3c2482c60d881b"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "e30f653210a64c730a04af52e000a0a9"
server_key_iv: "4902f624187d935194b6551d4fa58f92"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.067444 28712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e1f4f0302ed840bcaf3c2482c60d881b"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "e30f653210a64c730a04af52e000a0a9"
server_key_iv: "4902f624187d935194b6551d4fa58f92"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.073190 28712 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:38:58.077234 28728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:58.078737 28712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:58.078938 28712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e1f4f0302ed840bcaf3c2482c60d881b"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "e30f653210a64c730a04af52e000a0a9"
server_key_iv: "4902f624187d935194b6551d4fa58f92"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.079177 28712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:58.085937 28712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:58.086905 28712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:58.087246 28712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:58.106767 28712 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:36305
I20260811 01:38:58.106808 28782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:36305 every 8 connection(s)
I20260811 01:38:58.108243 28712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:38:58.111207 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28712
I20260811 01:38:58.111423 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:38:58.112373 17936 external_mini_cluster.cc:1428] Setting key c9254f183a8c6659202e8578ca2a8a83
I20260811 01:38:58.113092 28783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:38:58.121646 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:58.114652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.17.132.62:36305)
0811 01:38:58.115666 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:58.115677 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:58.115715 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:38:58.118076 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:58.118099 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:58.118508 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:58.118865 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:58.120057 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:58.120066 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:58.120081 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:58.120095 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:58.120162 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:58.120180 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:58.120346 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:58.120455 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 01:38:58.120762 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":387,"threads_started":1}
I20260811 01:38:58.126665 28783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b: Bootstrap starting.
I20260811 01:38:58.129741 28783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b: Neither blocks nor log segments found. Creating new log.
I20260811 01:38:58.130851 28783 log.cc:824] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:38:58.133884 28783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b: No bootstrap required, opened a new log
I20260811 01:38:58.141537 28783 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } }
I20260811 01:38:58.141992 28783 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:38:58.142096 28783 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1f4f0302ed840bcaf3c2482c60d881b, State: Initialized, Role: FOLLOWER
I20260811 01:38:58.142681 28783 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } }
I20260811 01:38:58.142932 28783 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:38:58.143069 28783 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:38:58.143241 28783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:38:58.145987 28783 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } }
I20260811 01:38:58.146533 28783 leader_election.cc:302] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1f4f0302ed840bcaf3c2482c60d881b; no voters:
I20260811 01:38:58.147181 28783 leader_election.cc:288] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:38:58.147354 28788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:38:58.148089 28788 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [term 1 LEADER]: Becoming Leader. State: Replica: e1f4f0302ed840bcaf3c2482c60d881b, State: Running, Role: LEADER
I20260811 01:38:58.148696 28788 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } }
I20260811 01:38:58.149469 28783 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:38:58.151472 28789 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } } }
I20260811 01:38:58.151880 28789 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:58.152400 28790 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1f4f0302ed840bcaf3c2482c60d881b. Latest consensus state: current_term: 1 leader_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1f4f0302ed840bcaf3c2482c60d881b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36305 } } }
I20260811 01:38:58.152823 28790 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b [sys.catalog]: This master's current role is: LEADER
I20260811 01:38:58.154371 28793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:38:58.160061 28793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:38:58.170219 28793 catalog_manager.cc:1347] Generated new cluster ID: 623a42e44bcf445887aacd2795cea9c6
I20260811 01:38:58.170353 28793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:38:58.205305 28793 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:38:58.205993 28793 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:38:58.214455 28793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1f4f0302ed840bcaf3c2482c60d881b: Generated new TSK 0
I20260811 01:38:58.215540 28793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:38:58.233318 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--builtin_ntp_servers=127.17.132.20:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:38:58.605691 28807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:58.606128 28807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:58.606287 28807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:58.614252 28807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:58.614374 28807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:58.614552 28807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:38:58.624928 28807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:58.626494 28807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:58.628499 28807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:58.643409 28816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:58.643471 28817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:58.643409 28821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:58.644726 28807 server_base.cc:1034] running on GCE node
I20260811 01:38:58.645401 28807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:58.646557 28807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:58.647799 28807 hybrid_clock.cc:648] HybridClock initialized: now 1786412338647751 us; error 34 us; skew 500 ppm
I20260811 01:38:58.648207 28807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:58.650938 28807 webserver.cc:460] Webserver started at http://127.17.132.1:38907/ using document root <none> and password file <none>
I20260811 01:38:58.651705 28807 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:58.651822 28807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:58.652179 28807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:58.655632 28807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "b7bcf0aecf11434aa85b51e6de0f075d"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "53a2116183fbaf51b0dc4aa760ce1dcd"
server_key_iv: "5e9798bca8b2235a69bba18311308fa5"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.656508 28807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "b7bcf0aecf11434aa85b51e6de0f075d"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "53a2116183fbaf51b0dc4aa760ce1dcd"
server_key_iv: "5e9798bca8b2235a69bba18311308fa5"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.661937 28807 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:38:58.666028 28828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:58.667455 28807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:38:58.667670 28807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "b7bcf0aecf11434aa85b51e6de0f075d"
format_stamp: "Formatted at 2026-08-11 01:38:58 on dist-test-slave-0kls"
server_key: "53a2116183fbaf51b0dc4aa760ce1dcd"
server_key_iv: "5e9798bca8b2235a69bba18311308fa5"
server_key_version: "encryptionkey@0"
I20260811 01:38:58.667932 28807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:58.674054 28807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:58.674916 28807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:58.675207 28807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:58.676208 28807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:58.678076 28807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:58.678228 28807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:58.678361 28807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:58.678452 28807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:58.715063 28807 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:41173
I20260811 01:38:58.715202 28955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:41173 every 8 connection(s)
I20260811 01:38:58.716519 28807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:38:58.724445 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28807
I20260811 01:38:58.724694 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:38:58.725194 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:58.719310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:33121 (local address 127.17.132.62:36305)
0811 01:38:58.719841 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:58.719846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:58.720924 (+ 1078us) server_negotiation.cc:407] Connection header received
0811 01:38:58.722787 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:58.722792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:58.722867 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:58.722988 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:58.724344 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:58.724350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:58.724354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:58.724379 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:58.724422 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:58.724434 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:58.724570 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:58.724801 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 01:38:58.724875 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":285,"threads_started":1}
I20260811 01:38:58.725445 17936 external_mini_cluster.cc:1428] Setting key 79883b4ba9d1857b9af6608d4ae437e7
I20260811 01:38:58.726234 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:58.719836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36305 (local address 127.17.132.1:33121)
0811 01:38:58.720758 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:58.720802 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:58.722508 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:58.723225 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:58.723233 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:58.723324 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:58.724040 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:58.724043 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:58.724083 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:58.724171 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:58.724531 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:58.724544 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:58.724553 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:38:58.724888 (+ 335us) client_negotiation.cc:240] Negotiation successful
0811 01:38:58.725148 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":295,"threads_started":1}
I20260811 01:38:58.728142 28956 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36305
I20260811 01:38:58.728363 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--builtin_ntp_servers=127.17.132.20:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:38:58.728444 28956 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:58.729068 28956 heartbeater.cc:511] Master 127.17.132.62:36305 requested a full tablet report, sending...
I20260811 01:38:58.731154 28747 ts_manager.cc:194] Registered new tserver with Master: b7bcf0aecf11434aa85b51e6de0f075d (127.17.132.1:41173)
W20260811 01:38:59.081525 28960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:59.081915 28960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:59.082027 28960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:59.089772 28960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:59.089953 28960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:59.090070 28960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:38:59.099845 28960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:59.101186 28960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:59.103080 28960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:59.118203 28968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:59.118185 28967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:59.119040 28971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:59.120184 28960 server_base.cc:1034] running on GCE node
I20260811 01:38:59.120864 28960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:59.122000 28960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:59.123238 28960 hybrid_clock.cc:648] HybridClock initialized: now 1786412339123174 us; error 62 us; skew 500 ppm
I20260811 01:38:59.123572 28960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:59.126116 28960 webserver.cc:460] Webserver started at http://127.17.132.2:42005/ using document root <none> and password file <none>
I20260811 01:38:59.126870 28960 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:59.127012 28960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:59.127339 28960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:59.130551 28960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "81c38a9869c744848fb32d41566f297f"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "c34870d9f1136ac65a2dcb673d5754aa"
server_key_iv: "ea8e78b8df690445cf20669804d5ff71"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.131438 28960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "81c38a9869c744848fb32d41566f297f"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "c34870d9f1136ac65a2dcb673d5754aa"
server_key_iv: "ea8e78b8df690445cf20669804d5ff71"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.136883 28960 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:38:59.140587 28977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.142096 28960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:38:59.142280 28960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "81c38a9869c744848fb32d41566f297f"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "c34870d9f1136ac65a2dcb673d5754aa"
server_key_iv: "ea8e78b8df690445cf20669804d5ff71"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.142514 28960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:59.148353 28960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:59.149170 28960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:59.149500 28960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:59.150559 28960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:59.151942 28960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:59.152031 28960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.152115 28960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:59.152174 28960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.187141 28960 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:34089
I20260811 01:38:59.187243 29107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:34089 every 8 connection(s)
I20260811 01:38:59.188489 28960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:38:59.190631 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 28960
I20260811 01:38:59.190829 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:38:59.191435 17936 external_mini_cluster.cc:1428] Setting key e9625af3db3940ec7007e14d177d7e80
I20260811 01:38:59.194690 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--builtin_ntp_servers=127.17.132.20:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:38:59.197575 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.191432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:35817 (local address 127.17.132.62:36305)
0811 01:38:59.191666 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.191671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.193276 (+ 1605us) server_negotiation.cc:407] Connection header received
0811 01:38:59.195244 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.195249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.195319 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.195441 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.196802 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:59.196808 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:59.196812 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:59.196832 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:59.196874 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:59.196886 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:59.197026 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:59.197221 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 01:38:59.197295 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:38:59.198590 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.192103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36305 (local address 127.17.132.2:35817)
0811 01:38:59.193111 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:59.193155 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:59.194967 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:59.195692 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:59.195701 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:59.195799 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:59.196498 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:59.196501 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:59.196540 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:59.196631 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:59.196983 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:59.196996 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:59.197005 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:38:59.197310 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 01:38:59.197578 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":302,"threads_started":1}
I20260811 01:38:59.200129 29108 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36305
I20260811 01:38:59.200558 29108 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:59.201186 29108 heartbeater.cc:511] Master 127.17.132.62:36305 requested a full tablet report, sending...
I20260811 01:38:59.202762 28747 ts_manager.cc:194] Registered new tserver with Master: 81c38a9869c744848fb32d41566f297f (127.17.132.2:34089)
W20260811 01:38:59.553612 29111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:38:59.554211 29111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:38:59.554384 29111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:38:59.562141 29111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:38:59.562286 29111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:38:59.562469 29111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:38:59.572062 29111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:38:59.573482 29111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:38:59.575327 29111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:38:59.594317 29119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:59.594274 29116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:38:59.594228 29117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:38:59.595475 29111 server_base.cc:1034] running on GCE node
I20260811 01:38:59.596256 29111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:38:59.597368 29111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:38:59.598608 29111 hybrid_clock.cc:648] HybridClock initialized: now 1786412339598536 us; error 73 us; skew 500 ppm
I20260811 01:38:59.598961 29111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:38:59.601680 29111 webserver.cc:460] Webserver started at http://127.17.132.3:38849/ using document root <none> and password file <none>
I20260811 01:38:59.602533 29111 fs_manager.cc:359] Metadata directory not provided
I20260811 01:38:59.602689 29111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:38:59.603068 29111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:38:59.606388 29111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "2d2cdf719a084ff08de509f7f6b2dd43"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "fb92e248db69b00f6aa6f109b34faa8c"
server_key_iv: "0fdcc9cb1370479ec30eabe6daab9232"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.607299 29111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "2d2cdf719a084ff08de509f7f6b2dd43"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "fb92e248db69b00f6aa6f109b34faa8c"
server_key_iv: "0fdcc9cb1370479ec30eabe6daab9232"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.613147 29111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:38:59.617030 29126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.618765 29111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:38:59.618973 29111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "2d2cdf719a084ff08de509f7f6b2dd43"
format_stamp: "Formatted at 2026-08-11 01:38:59 on dist-test-slave-0kls"
server_key: "fb92e248db69b00f6aa6f109b34faa8c"
server_key_iv: "0fdcc9cb1370479ec30eabe6daab9232"
server_key_version: "encryptionkey@0"
I20260811 01:38:59.619237 29111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:38:59.625507 29111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:38:59.626495 29111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:38:59.626819 29111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:38:59.627882 29111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:38:59.629441 29111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:38:59.629570 29111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.629725 29111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:38:59.629865 29111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:38:59.667969 29111 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:45633
I20260811 01:38:59.668033 29250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:45633 every 8 connection(s)
I20260811 01:38:59.669407 29111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:38:59.675601 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 29111
I20260811 01:38:59.675794 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:38:59.676278 17936 external_mini_cluster.cc:1428] Setting key d1b8c862f1439a25408cdb23996580a6
I20260811 01:38:59.678797 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.672326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:57957 (local address 127.17.132.62:36305)
0811 01:38:59.672543 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.672550 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.674210 (+ 1660us) server_negotiation.cc:407] Connection header received
0811 01:38:59.676051 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.676057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.676142 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.676257 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.677931 (+ 1674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:59.677941 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:59.677944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:59.677982 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:59.678028 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:59.678044 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:59.678158 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:59.678476 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 01:38:59.678543 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:38:59.680176 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.672956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36305 (local address 127.17.132.3:57957)
0811 01:38:59.674033 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0811 01:38:59.674073 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:38:59.675698 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:38:59.676498 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:38:59.676506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:38:59.676604 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:38:59.677460 (+ 856us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:38:59.677463 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:38:59.677517 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:38:59.677690 (+ 173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:38:59.678225 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:38:59.678240 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:38:59.678249 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:38:59.678542 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 01:38:59.678839 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":298,"threads_started":1}
I20260811 01:38:59.681617 29251 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36305
I20260811 01:38:59.681995 29251 heartbeater.cc:464] Registering TS with master...
I20260811 01:38:59.682683 29251 heartbeater.cc:511] Master 127.17.132.62:36305 requested a full tablet report, sending...
I20260811 01:38:59.684273 28747 ts_manager.cc:194] Registered new tserver with Master: 2d2cdf719a084ff08de509f7f6b2dd43 (127.17.132.3:45633)
I20260811 01:38:59.693295 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:38:59.700887 28958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:38:59.699062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.17.132.62:36305)
0811 01:38:59.699278 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.699288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.699792 (+ 504us) server_negotiation.cc:407] Connection header received
0811 01:38:59.700005 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.700017 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.700077 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.700187 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.700559 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35246: BlockingRecv error: recv got EOF from 127.0.0.1:35246 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:38:59.701872 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28807
I20260811 01:38:59.705658 29261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.703082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.17.132.1:41173)
0811 01:38:59.703594 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.703601 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.703628 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:38:59.703690 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.703696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.703927 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.704054 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.704995 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:59.705002 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:59.705013 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:59.705030 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:59.705071 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:59.705085 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:59.705192 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:59.705323 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 01:38:59.705402 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":256,"threads_started":1}
I20260811 01:38:59.706939 28949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:59.791569 28956 heartbeater.cc:503] Master 127.17.132.62:36305 was elected leader, sending a full tablet report...
I20260811 01:38:59.793959 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28807
I20260811 01:38:59.814888 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28960
I20260811 01:38:59.818988 29263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.815974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.17.132.2:34089)
0811 01:38:59.816563 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.816578 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.816606 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:38:59.816676 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.816682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.816961 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.817108 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.818233 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:59.818239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:59.818251 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:59.818271 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:59.818315 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:59.818329 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:59.818434 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:59.818575 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:38:59.818697 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":304,"threads_started":1}
I20260811 01:38:59.820422 29101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:38:59.905704 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28960
I20260811 01:38:59.926996 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 29111
I20260811 01:38:59.931458 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:38:59.928217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.17.132.3:45633)
0811 01:38:59.928823 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 01:38:59.928830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:38:59.928864 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:38:59.928929 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:38:59.928936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:38:59.929203 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:38:59.929393 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:38:59.930655 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:38:59.930662 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:38:59.930675 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:38:59.930688 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:38:59.930730 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:38:59.930745 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:38:59.930946 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:38:59.931020 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 01:38:59.931151 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":291,"threads_started":1}
I20260811 01:38:59.932911 29246 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:00.019872 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 29111
I20260811 01:39:00.042834 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 28712
I20260811 01:39:00.044287 28778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:00.149333 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 28712
2026-08-11T01:39:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2575 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:39:00 dist-test-slave-0kls krb5kdc[29271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:39:00 dist-test-slave-0kls krb5kdc[29271](info): set up 2 sockets
Aug 11 01:39:00 dist-test-slave-0kls krb5kdc[29271](info): commencing operation
krb5kdc: starting...
W20260811 01:39:01.338967 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:39:01 dist-test-slave-0kls krb5kdc[29271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:39:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:39:01.657497 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42929
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:42929
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:39:02.020318 29285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:02.020694 29285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:02.020901 29285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:02.028401 29285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:39:02.028560 29285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:02.028667 29285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:02.028771 29285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:39:02.028847 29285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:39:02.039250 29285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:42929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:02.040804 29285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:02.042241 29285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:02.054273 29290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:02.054334 29293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:02.054312 29291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:02.055549 29285 server_base.cc:1034] running on GCE node
I20260811 01:39:02.056443 29285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:02.058000 29285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:02.059245 29285 hybrid_clock.cc:648] HybridClock initialized: now 1786412342059205 us; error 43 us; skew 500 ppm
I20260811 01:39:02.059616 29285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:02 dist-test-slave-0kls krb5kdc[29271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412342, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:02.062860 29285 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:39:02.064496 29285 webserver.cc:460] Webserver started at http://127.17.132.62:45919/ using document root <none> and password file <none>
I20260811 01:39:02.065253 29285 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:02.065407 29285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:02.065735 29285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:39:02.068922 29285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "8cd75fd8ef8b07f77a526183fe772e9d"
server_key_iv: "d8f7463d91e3f02ac00c06c00f839394"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.069772 29285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "8cd75fd8ef8b07f77a526183fe772e9d"
server_key_iv: "d8f7463d91e3f02ac00c06c00f839394"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.075548 29285 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 01:39:02.079247 29301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:02.080688 29285 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:39:02.080889 29285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "8cd75fd8ef8b07f77a526183fe772e9d"
server_key_iv: "d8f7463d91e3f02ac00c06c00f839394"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.081099 29285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:02.100687 29285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:02.105136 29285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:02.105459 29285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:02.125221 29285 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:42929
I20260811 01:39:02.125269 29360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:42929 every 8 connection(s)
I20260811 01:39:02.126744 29285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:39:02.130575 29361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:02.130753 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 29285
I20260811 01:39:02.130971 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:39:02.131685 17936 external_mini_cluster.cc:1428] Setting key a6fd75f2c5a12ddd50784ba9d45d04b7
I20260811 01:39:02.146165 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: Bootstrap starting.
Aug 11 01:39:02 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:02.150107 29361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:02.151847 29361 log.cc:824] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:02.155506 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: No bootstrap required, opened a new log
I20260811 01:39:02.158303 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:02.133748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.17.132.62:42929)
0811 01:39:02.134603 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:02.134619 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:02.134682 (+ 63us) server_negotiation.cc:407] Connection header received
0811 01:39:02.137514 (+ 2832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:02.137545 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:02.138136 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:02.138631 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:02.140173 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.142286 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.143660 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.144784 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.144991 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:02.149052 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:02.149065 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:02.149087 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:02.149143 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:02.153292 (+ 4149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:02.154170 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:02.154183 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:02.154193 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:02.154412 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:02.154834 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:02.154839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:02.154842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:02.155516 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:02.156003 (+ 487us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:02.156411 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 01:39:02.156875 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":315,"threads_started":1}
I20260811 01:39:02.164860 29361 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } }
I20260811 01:39:02.165246 29361 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:02.165323 29361 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcda5c9c7ad14a4aa0f80e6951ae5709, State: Initialized, Role: FOLLOWER
I20260811 01:39:02.165937 29361 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } }
I20260811 01:39:02.166167 29361 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:39:02.166271 29361 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:39:02.166400 29361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:02.168946 29361 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } }
I20260811 01:39:02.169476 29361 leader_election.cc:302] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcda5c9c7ad14a4aa0f80e6951ae5709; no voters:
I20260811 01:39:02.170120 29361 leader_election.cc:288] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:39:02.170293 29366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:39:02.171130 29366 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [term 1 LEADER]: Becoming Leader. State: Replica: dcda5c9c7ad14a4aa0f80e6951ae5709, State: Running, Role: LEADER
I20260811 01:39:02.171777 29366 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } }
I20260811 01:39:02.172452 29361 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:39:02.175232 29367 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } } }
I20260811 01:39:02.175258 29368 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcda5c9c7ad14a4aa0f80e6951ae5709. Latest consensus state: current_term: 1 leader_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcda5c9c7ad14a4aa0f80e6951ae5709" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42929 } } }
I20260811 01:39:02.175732 29367 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [sys.catalog]: This master's current role is: LEADER
I20260811 01:39:02.175794 29368 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709 [sys.catalog]: This master's current role is: LEADER
I20260811 01:39:02.176643 29371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:39:02.183502 29371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:39:02.193295 29371 catalog_manager.cc:1347] Generated new cluster ID: 5f0b018f2a7445b78050cb95983e43eb
I20260811 01:39:02.193437 29371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:39:02.211079 29371 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:39:02.212944 29371 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:39:02.229887 29371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: Generated new TSK 0
I20260811 01:39:02.230775 29371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:39:02.321768 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:39:02.681398 29388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:02.681694 29388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:02.681850 29388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:02.689366 29388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:02.689482 29388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:02.689599 29388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:39:02.699700 29388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:02.701051 29388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:02.702442 29388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:02.717167 29393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:02.717051 29398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:02.717163 29395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:02.718024 29388 server_base.cc:1034] running on GCE node
I20260811 01:39:02.718660 29388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:02.719667 29388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:02.720880 29388 hybrid_clock.cc:648] HybridClock initialized: now 1786412342720836 us; error 31 us; skew 500 ppm
I20260811 01:39:02.721235 29388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:02 dist-test-slave-0kls krb5kdc[29271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412342, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:02.724524 29388 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:39:02.726190 29388 webserver.cc:460] Webserver started at http://127.17.132.1:40209/ using document root <none> and password file <none>
I20260811 01:39:02.726915 29388 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:02.727051 29388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:02.727377 29388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:39:02.730734 29388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "cc9d32b2adc3447b99a9236890e8bf12"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "cbd11bb7b4bacaa2d3a010b21f09ca5e"
server_key_iv: "fca64cb4c458bd2e088eef404a5a3e91"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.731516 29388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "cc9d32b2adc3447b99a9236890e8bf12"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "cbd11bb7b4bacaa2d3a010b21f09ca5e"
server_key_iv: "fca64cb4c458bd2e088eef404a5a3e91"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.736763 29388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:39:02.740435 29405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:02.742043 29388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:39:02.742228 29388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "cc9d32b2adc3447b99a9236890e8bf12"
format_stamp: "Formatted at 2026-08-11 01:39:02 on dist-test-slave-0kls"
server_key: "cbd11bb7b4bacaa2d3a010b21f09ca5e"
server_key_iv: "fca64cb4c458bd2e088eef404a5a3e91"
server_key_version: "encryptionkey@0"
I20260811 01:39:02.742452 29388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:02.765959 29388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:02.770234 29388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:02.770553 29388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:02.771593 29388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:02.773159 29388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:02.773270 29388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:02.773422 29388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:02.773494 29388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:02.809002 29388 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:43081
I20260811 01:39:02.809060 29528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:43081 every 8 connection(s)
I20260811 01:39:02.810336 29388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:39:02.814934 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 29388
I20260811 01:39:02.815157 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:39:02.815989 17936 external_mini_cluster.cc:1428] Setting key e1fb319d9e90e088f98a3a983523e074
Aug 11 01:39:02 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412342, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:02.833870 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:02.812988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:39317 (local address 127.17.132.62:42929)
0811 01:39:02.813469 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:02.813476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:02.814539 (+ 1063us) server_negotiation.cc:407] Connection header received
0811 01:39:02.817185 (+ 2646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:02.817192 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:02.817276 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:02.817394 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:02.819580 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.820323 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.823166 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.823573 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.823682 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:02.827917 (+ 4235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:02.827921 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:02.827925 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:02.827958 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:02.830619 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:02.831379 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:02.831384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:02.831386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:02.831514 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:02.831964 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:02.831968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:02.831970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:02.832255 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:02.832417 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:02.833185 (+ 768us) server_negotiation.cc:299] Negotiation successful
0811 01:39:02.833425 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":225,"threads_started":1}
I20260811 01:39:02.834992 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:02.813543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42929 (local address 127.17.132.1:39317)
0811 01:39:02.814326 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:02.814402 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:02.816844 (+ 2442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:02.817642 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:02.817652 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:02.818502 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:02.819357 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:02.819386 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.820503 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.820511 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:02.822977 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:02.822994 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:02.823814 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:02.823824 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:02.824161 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:02.824908 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:02.824944 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:02.827687 (+ 2743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:02.830766 (+ 3079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:02.830777 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:02.830794 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:02.831241 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:02.831635 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:02.831640 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:02.831644 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:02.831836 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:02.832389 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:02.832397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:02.832766 (+ 369us) client_negotiation.cc:769] Sending connection context
0811 01:39:02.833036 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 01:39:02.833608 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":321,"threads_started":1}
I20260811 01:39:02.836732 29529 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42929
I20260811 01:39:02.837055 29529 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:02.837905 29529 heartbeater.cc:511] Master 127.17.132.62:42929 requested a full tablet report, sending...
I20260811 01:39:02.840399 29324 ts_manager.cc:194] Registered new tserver with Master: cc9d32b2adc3447b99a9236890e8bf12 (127.17.132.1:43081)
I20260811 01:39:02.842974 29324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:39317
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:39:02.887409 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:39:03.242111 29536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:03.242476 29536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:03.242643 29536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:03.250411 29536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:03.250588 29536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:03.250787 29536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:39:03.261093 29536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:03.262552 29536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:03.263936 29536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:03.277755 29542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:03.277801 29541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:03.277701 29545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:03.278448 29536 server_base.cc:1034] running on GCE node
I20260811 01:39:03.279117 29536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:03.280179 29536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:03.281412 29536 hybrid_clock.cc:648] HybridClock initialized: now 1786412343281370 us; error 35 us; skew 500 ppm
I20260811 01:39:03.281741 29536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:03 dist-test-slave-0kls krb5kdc[29271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412343, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:03.289032 29536 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:39:03.290663 29536 webserver.cc:460] Webserver started at http://127.17.132.2:36129/ using document root <none> and password file <none>
I20260811 01:39:03.291406 29536 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:03.291534 29536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:03.291815 29536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:39:03.295238 29536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "10d2de52f5d54be39b2d4f8456cb87ca"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "00fbfdfecca62856690534c8492bd063"
server_key_iv: "c1904eac4321c0292ecde15fb1207e60"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.296003 29536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "10d2de52f5d54be39b2d4f8456cb87ca"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "00fbfdfecca62856690534c8492bd063"
server_key_iv: "c1904eac4321c0292ecde15fb1207e60"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.301455 29536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:39:03.305182 29552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.306653 29536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:39:03.306885 29536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "10d2de52f5d54be39b2d4f8456cb87ca"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "00fbfdfecca62856690534c8492bd063"
server_key_iv: "c1904eac4321c0292ecde15fb1207e60"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.307122 29536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:03.334404 29536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:03.339303 29536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:03.339643 29536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:03.340812 29536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:03.342338 29536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:03.342446 29536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.342599 29536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:03.342672 29536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.378428 29536 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:33385
I20260811 01:39:03.378463 29670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:33385 every 8 connection(s)
I20260811 01:39:03.379875 29536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:39:03.388695 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 29536
I20260811 01:39:03.388911 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:39:03.389519 17936 external_mini_cluster.cc:1428] Setting key 2ad1d7d4e68c027c432f1ee26301fa49
Aug 11 01:39:03 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412343, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:03.401686 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:03.382754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:43529 (local address 127.17.132.62:42929)
0811 01:39:03.383255 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:03.383260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:03.384271 (+ 1011us) server_negotiation.cc:407] Connection header received
0811 01:39:03.386326 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:03.386332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:03.386430 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:03.386556 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:03.388119 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.388935 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.391142 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.391722 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.391862 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:03.395486 (+ 3624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:03.395491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:03.395494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:03.395527 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:03.398339 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:03.399150 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:03.399155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:03.399157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:03.399294 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:03.399787 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:03.399791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:03.399793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:03.400079 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:03.400263 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:03.401032 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 01:39:03.401290 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":263,"threads_started":1}
I20260811 01:39:03.402803 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:03.383335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42929 (local address 127.17.132.2:43529)
0811 01:39:03.384069 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:03.384109 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:03.386040 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:03.386811 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:03.386820 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:03.387363 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:03.387936 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:03.387955 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.389128 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.389133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:03.390985 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:03.390999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.391958 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.391966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:03.392239 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:03.392958 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:03.392982 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:03.395249 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:03.398501 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:03.398511 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:03.398531 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:03.398998 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:03.399415 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:03.399420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:03.399423 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:03.399639 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:03.400236 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:03.400245 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:03.400632 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 01:39:03.400918 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 01:39:03.401512 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":288,"threads_started":1}
I20260811 01:39:03.404429 29671 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42929
I20260811 01:39:03.404788 29671 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:03.405722 29671 heartbeater.cc:511] Master 127.17.132.62:42929 requested a full tablet report, sending...
I20260811 01:39:03.407534 29324 ts_manager.cc:194] Registered new tserver with Master: 10d2de52f5d54be39b2d4f8456cb87ca (127.17.132.2:33385)
I20260811 01:39:03.408412 29324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:43529
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:39:03.457151 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:39:03.814050 29677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:03.814312 29677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:03.814409 29677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:03.821704 29677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:03.821897 29677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:03.822032 29677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:39:03.832033 29677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42929
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:03.833323 29677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:03.834767 29677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:39:03.846808 29529 heartbeater.cc:503] Master 127.17.132.62:42929 was elected leader, sending a full tablet report...
W20260811 01:39:03.849471 29683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:03.849579 29684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:03.850121 29687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:03.850841 29677 server_base.cc:1034] running on GCE node
I20260811 01:39:03.851554 29677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:03.852644 29677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:03.853907 29677 hybrid_clock.cc:648] HybridClock initialized: now 1786412343853868 us; error 32 us; skew 500 ppm
I20260811 01:39:03.854249 29677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:03 dist-test-slave-0kls krb5kdc[29271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412343, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:03.857534 29677 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:39:03.859200 29677 webserver.cc:460] Webserver started at http://127.17.132.3:39959/ using document root <none> and password file <none>
I20260811 01:39:03.859903 29677 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:03.860009 29677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:03.860262 29677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:39:03.863354 29677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "cca197712bfb4f8c9809ed50ad3d0b93"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "a5c77d72b5a2859a40798ce2b9bee7d1"
server_key_iv: "e7e58a2c69edbc1d2ff927fe9467e036"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.864143 29677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "cca197712bfb4f8c9809ed50ad3d0b93"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "a5c77d72b5a2859a40798ce2b9bee7d1"
server_key_iv: "e7e58a2c69edbc1d2ff927fe9467e036"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.871152 29677 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 01:39:03.875507 29694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.877097 29677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:39:03.877315 29677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "cca197712bfb4f8c9809ed50ad3d0b93"
format_stamp: "Formatted at 2026-08-11 01:39:03 on dist-test-slave-0kls"
server_key: "a5c77d72b5a2859a40798ce2b9bee7d1"
server_key_iv: "e7e58a2c69edbc1d2ff927fe9467e036"
server_key_version: "encryptionkey@0"
I20260811 01:39:03.877537 29677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:03.920563 29677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:03.925169 29677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:03.925510 29677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:03.926568 29677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:03.928047 29677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:03.928124 29677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.928314 29677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:03.928368 29677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:03.962827 29677 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:36619
I20260811 01:39:03.962934 29822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:36619 every 8 connection(s)
I20260811 01:39:03.964232 29677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:39:03.971010 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 29677
I20260811 01:39:03.971230 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:39:03.971701 17936 external_mini_cluster.cc:1428] Setting key 8fed57589f88afb06a53a6c89394cdfb
Aug 11 01:39:03 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412343, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:03.985378 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:03.966862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54767 (local address 127.17.132.62:42929)
0811 01:39:03.967348 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:03.967352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:03.968142 (+ 790us) server_negotiation.cc:407] Connection header received
0811 01:39:03.970117 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:03.970123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:03.970236 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:03.970364 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:03.972057 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.973190 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.975575 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.975978 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.976077 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:03.979523 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:03.979528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:03.979531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:03.979564 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:03.982464 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:03.983224 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:03.983228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:03.983230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:03.983358 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:03.983743 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:03.983746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:03.983748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:03.984008 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:03.984127 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:03.984847 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 01:39:03.985017 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":255,"threads_started":1}
I20260811 01:39:03.986768 29828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:03.967258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42929 (local address 127.17.132.3:54767)
0811 01:39:03.967959 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:03.968010 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:03.969772 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:03.970612 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:03.970620 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:03.971152 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:03.971880 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:03.971900 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.973717 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.973721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:03.975437 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:03.975451 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:03.976197 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:03.976201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:03.976397 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:03.977038 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:03.977086 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:03.979335 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:03.982594 (+ 3259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:03.982601 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:03.982613 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:03.983082 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:03.983456 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:03.983459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:03.983462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:03.983640 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:03.984125 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:03.984131 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:03.984513 (+ 382us) client_negotiation.cc:769] Sending connection context
0811 01:39:03.984740 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 01:39:03.985245 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":289,"threads_started":1}
I20260811 01:39:03.988154 29824 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42929
I20260811 01:39:03.988508 29824 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:03.989284 29824 heartbeater.cc:511] Master 127.17.132.62:42929 requested a full tablet report, sending...
I20260811 01:39:03.990842 29324 ts_manager.cc:194] Registered new tserver with Master: cca197712bfb4f8c9809ed50ad3d0b93 (127.17.132.3:36619)
I20260811 01:39:03.991676 29324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:54767
I20260811 01:39:04.000429 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:39:04.021755 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.008089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40238 (local address 127.17.132.62:42929)
0811 01:39:04.008371 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.008380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.008788 (+ 408us) server_negotiation.cc:407] Connection header received
0811 01:39:04.008975 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.008981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.009070 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.009187 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:04.011062 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.011965 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.013167 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.013901 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.014017 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.016363 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:04.016369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:04.016372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:04.016411 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:04.019205 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.019890 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.019894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.019896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.020021 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.020394 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.020398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.020400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.020723 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:04.020919 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.021350 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.021525 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:39:04.026211 29324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:39:04.033188 29324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:39:04.058547 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.046269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43081 (local address 127.0.0.1:42348)
0811 01:39:04.047509 (+ 1240us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:04.047569 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:04.047785 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:04.051720 (+ 3935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:04.051725 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:04.051750 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:04.052217 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.052231 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.054092 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.054098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.056030 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.056046 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057376 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.057578 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.057638 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 01:39:04.057840 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 01:39:04.058076 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"mutex_wait_us":1,"thread_start_us":1884,"threads_started":1}
I20260811 01:39:04.058609 29840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.046588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42348 (local address 127.17.132.1:43081)
0811 01:39:04.050786 (+ 4198us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.050792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.050816 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:39:04.050937 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.050943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.051160 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.051380 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:04.052426 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.053921 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.056219 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057171 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057337 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.057587 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.058100 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.058292 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4047,"thread_start_us":3876,"threads_started":1}
I20260811 01:39:04.058967 29839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.046587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:36619 (local address 127.0.0.1:41436)
0811 01:39:04.048427 (+ 1840us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:04.048443 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:04.048554 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:04.049818 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:04.049825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:04.049855 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:04.050345 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.050361 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.052602 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.052610 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.055345 (+ 2735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.055367 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057750 (+ 2383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.057977 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.058114 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 01:39:04.058212 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:39:04.058592 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1715,"mutex_wait_us":272,"thread_start_us":1190,"threads_started":1}
I20260811 01:39:04.058964 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.047346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41436 (local address 127.17.132.3:36619)
0811 01:39:04.049093 (+ 1747us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.049103 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.049141 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:39:04.049265 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.049273 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.049549 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.050535 (+ 986us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:04.050834 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.052458 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.055560 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057187 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057327 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.057577 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.058413 (+ 836us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.058597 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1563,"thread_start_us":2259,"threads_started":1}
I20260811 01:39:04.059387 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.048788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:33385 (local address 127.0.0.1:55502)
0811 01:39:04.049668 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:04.049686 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:04.049819 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:04.050917 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:04.050922 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:04.050950 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:04.051347 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.051361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.053513 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.053519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.055860 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.055874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057838 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.058120 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.058149 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 01:39:04.058237 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 01:39:04.058367 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":119,"thread_start_us":1070,"threads_started":1}
I20260811 01:39:04.059960 29844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.049398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55502 (local address 127.17.132.2:33385)
0811 01:39:04.050302 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.050313 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.050343 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:39:04.050440 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.050450 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.050684 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.050911 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:04.051585 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.053364 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.056065 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.057574 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.057738 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.057943 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.059449 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.059615 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":615,"threads_started":1}
I20260811 01:39:04.062860 29749 tablet_service.cc:1467] Processing CreateTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (DEFAULT_TABLE table=test-table [id=0757155780dd4b6dbd9c50a81fba679f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:04.063365 29457 tablet_service.cc:1467] Processing CreateTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (DEFAULT_TABLE table=test-table [id=0757155780dd4b6dbd9c50a81fba679f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:04.063364 29604 tablet_service.cc:1467] Processing CreateTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (DEFAULT_TABLE table=test-table [id=0757155780dd4b6dbd9c50a81fba679f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:04.064241 29749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9deb7ccfdc842178f2a643f6e4bc8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:04.064733 29457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9deb7ccfdc842178f2a643f6e4bc8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:04.064759 29604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9deb7ccfdc842178f2a643f6e4bc8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:04.076985 29845 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Bootstrap starting.
I20260811 01:39:04.080339 29846 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Bootstrap starting.
I20260811 01:39:04.081801 29845 tablet_bootstrap.cc:654] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:04.082202 29847 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Bootstrap starting.
I20260811 01:39:04.083535 29845 log.cc:824] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:04.084578 29846 tablet_bootstrap.cc:654] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:04.085831 29846 log.cc:824] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:04.086123 29847 tablet_bootstrap.cc:654] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:04.087177 29845 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: No bootstrap required, opened a new log
I20260811 01:39:04.087539 29845 ts_tablet_manager.cc:1397] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:39:04.087379 29847 log.cc:824] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:04.088744 29846 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: No bootstrap required, opened a new log
I20260811 01:39:04.089013 29846 ts_tablet_manager.cc:1397] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260811 01:39:04.092468 29847 tablet_bootstrap.cc:492] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: No bootstrap required, opened a new log
I20260811 01:39:04.092757 29847 ts_tablet_manager.cc:1397] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260811 01:39:04.096632 29846 raft_consensus.cc:348] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.097051 29846 raft_consensus.cc:374] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:04.097169 29846 raft_consensus.cc:729] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9d32b2adc3447b99a9236890e8bf12, State: Initialized, Role: FOLLOWER
I20260811 01:39:04.097920 29846 consensus_queue.cc:260] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.099201 29845 raft_consensus.cc:348] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.099735 29845 raft_consensus.cc:374] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:04.099907 29845 raft_consensus.cc:729] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca197712bfb4f8c9809ed50ad3d0b93, State: Initialized, Role: FOLLOWER
I20260811 01:39:04.100574 29845 consensus_queue.cc:260] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.101943 29824 heartbeater.cc:503] Master 127.17.132.62:42929 was elected leader, sending a full tablet report...
I20260811 01:39:04.103255 29846 ts_tablet_manager.cc:1428] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260811 01:39:04.104067 29847 raft_consensus.cc:348] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.104574 29845 ts_tablet_manager.cc:1428] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Time spent starting tablet: real 0.017s user 0.013s sys 0.000s
I20260811 01:39:04.104578 29847 raft_consensus.cc:374] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:04.104719 29847 raft_consensus.cc:729] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d2de52f5d54be39b2d4f8456cb87ca, State: Initialized, Role: FOLLOWER
I20260811 01:39:04.105482 29847 consensus_queue.cc:260] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.106768 29671 heartbeater.cc:503] Master 127.17.132.62:42929 was elected leader, sending a full tablet report...
I20260811 01:39:04.108677 29847 ts_tablet_manager.cc:1428] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260811 01:39:04.132042 29672 tablet.cc:2369] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:39:04.215973 29825 tablet.cc:2369] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:39:04.257822 29851 raft_consensus.cc:482] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:39:04.258122 29851 raft_consensus.cc:504] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.260040 29851 leader_election.cc:288] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca197712bfb4f8c9809ed50ad3d0b93 (127.17.132.3:36619), 10d2de52f5d54be39b2d4f8456cb87ca (127.17.132.2:33385)
I20260811 01:39:04.269089 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.260473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:39585 (local address 127.17.132.3:36619)
0811 01:39:04.260680 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.260684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.261151 (+ 467us) server_negotiation.cc:407] Connection header received
0811 01:39:04.261392 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.261399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.261487 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.261640 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:04.262490 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.263542 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.266394 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.267777 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.267975 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.268069 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.268656 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.268808 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:39:04.269124 29844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.261503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:34757 (local address 127.17.132.2:33385)
0811 01:39:04.261739 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.261746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.261988 (+ 242us) server_negotiation.cc:407] Connection header received
0811 01:39:04.262148 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.262152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.262213 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.262291 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:04.262847 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.263844 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.266394 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.267781 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.267975 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.268068 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.268656 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.268808 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:39:04.269385 29855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.261147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:33385 (local address 127.17.132.1:34757)
0811 01:39:04.261857 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:04.261876 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:04.262022 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:04.262335 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:04.262339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:04.262367 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:04.262676 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.262684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.263968 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.263978 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.266184 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.266193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.268134 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.268141 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.268425 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.268471 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:39:04.268573 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 01:39:04.268809 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":168,"thread_start_us":366,"threads_started":1}
I20260811 01:39:04.269409 29854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.260340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:36619 (local address 127.17.132.1:39585)
0811 01:39:04.261023 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:04.261044 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:04.261209 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:04.261772 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:04.261778 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:04.261831 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:04.262326 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.262337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.263687 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.263690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.266175 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:04.266193 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.268100 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.268113 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:04.268417 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.268468 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 01:39:04.268573 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:39:04.268809 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":151,"spinlock_wait_cycles":23808,"thread_start_us":355,"threads_started":1}
I20260811 01:39:04.270537 29772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9deb7ccfdc842178f2a643f6e4bc8e0" candidate_uuid: "cc9d32b2adc3447b99a9236890e8bf12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" is_pre_election: true
I20260811 01:39:04.270534 29625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9deb7ccfdc842178f2a643f6e4bc8e0" candidate_uuid: "cc9d32b2adc3447b99a9236890e8bf12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" is_pre_election: true
I20260811 01:39:04.271065 29625 raft_consensus.cc:2454] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9d32b2adc3447b99a9236890e8bf12 in term 0.
I20260811 01:39:04.271064 29772 raft_consensus.cc:2454] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9d32b2adc3447b99a9236890e8bf12 in term 0.
I20260811 01:39:04.271811 29406 leader_election.cc:302] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9d32b2adc3447b99a9236890e8bf12, cca197712bfb4f8c9809ed50ad3d0b93; no voters:
I20260811 01:39:04.272303 29851 raft_consensus.cc:2781] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:39:04.272491 29851 raft_consensus.cc:482] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:39:04.272626 29851 raft_consensus.cc:3037] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:04.275076 29851 raft_consensus.cc:504] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.275787 29851 leader_election.cc:288] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [CANDIDATE]: Term 1 election: Requested vote from peers cca197712bfb4f8c9809ed50ad3d0b93 (127.17.132.3:36619), 10d2de52f5d54be39b2d4f8456cb87ca (127.17.132.2:33385)
I20260811 01:39:04.276441 29772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9deb7ccfdc842178f2a643f6e4bc8e0" candidate_uuid: "cc9d32b2adc3447b99a9236890e8bf12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca197712bfb4f8c9809ed50ad3d0b93"
I20260811 01:39:04.276510 29625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9deb7ccfdc842178f2a643f6e4bc8e0" candidate_uuid: "cc9d32b2adc3447b99a9236890e8bf12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d2de52f5d54be39b2d4f8456cb87ca"
I20260811 01:39:04.276706 29772 raft_consensus.cc:3037] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:04.276762 29625 raft_consensus.cc:3037] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:04.279243 29772 raft_consensus.cc:2454] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9d32b2adc3447b99a9236890e8bf12 in term 1.
I20260811 01:39:04.279251 29625 raft_consensus.cc:2454] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9d32b2adc3447b99a9236890e8bf12 in term 1.
I20260811 01:39:04.279790 29406 leader_election.cc:302] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d2de52f5d54be39b2d4f8456cb87ca, cc9d32b2adc3447b99a9236890e8bf12; no voters:
I20260811 01:39:04.280172 29851 raft_consensus.cc:2781] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:39:04.280671 29851 raft_consensus.cc:686] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 1 LEADER]: Becoming Leader. State: Replica: cc9d32b2adc3447b99a9236890e8bf12, State: Running, Role: LEADER
I20260811 01:39:04.281196 29851 consensus_queue.cc:237] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } }
I20260811 01:39:04.286623 29322 catalog_manager.cc:5495] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9d32b2adc3447b99a9236890e8bf12 (127.17.132.1). New cstate: current_term: 1 leader_uuid: "cc9d32b2adc3447b99a9236890e8bf12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9d32b2adc3447b99a9236890e8bf12" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 } health_report { overall_health: UNKNOWN } } }
W20260811 01:39:04.313318 29530 tablet.cc:2369] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:39:04.356541 29840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.350923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.17.132.1:43081)
0811 01:39:04.351179 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.351185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.351206 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:39:04.351414 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.351418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.351498 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.351665 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:39:04.352047 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.352806 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.354324 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.354763 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.354897 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.355422 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:39:04.355939 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:39:04.356124 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.356179 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.356270 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:39:04.365379 29625 raft_consensus.cc:1261] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 1 FOLLOWER]: Refusing update from remote peer cc9d32b2adc3447b99a9236890e8bf12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:39:04.365379 29772 raft_consensus.cc:1261] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 1 FOLLOWER]: Refusing update from remote peer cc9d32b2adc3447b99a9236890e8bf12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:39:04.366513 29851 consensus_queue.cc:1035] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca197712bfb4f8c9809ed50ad3d0b93" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:39:04.366909 29856 consensus_queue.cc:1035] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d2de52f5d54be39b2d4f8456cb87ca" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:39:04.380476 29860 mvcc.cc:205] Tried to move back new op lower bound from 7317144962509111296 to 7317144962180317184. Current Snapshot: MvccSnapshot[applied={T|T < 7317144962509111296}]
I20260811 01:39:04.381448 29862 mvcc.cc:205] Tried to move back new op lower bound from 7317144962509111296 to 7317144962180317184. Current Snapshot: MvccSnapshot[applied={T|T < 7317144962509111296}]
I20260811 01:39:04.383054 29861 mvcc.cc:205] Tried to move back new op lower bound from 7317144962509111296 to 7317144962180317184. Current Snapshot: MvccSnapshot[applied={T|T < 7317144962509111296}]
I20260811 01:39:04.405573 29324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:39:04.405936 29324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:39:04.409498 29324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dcda5c9c7ad14a4aa0f80e6951ae5709: Sending DeleteTablet for 3 replicas of tablet c9deb7ccfdc842178f2a643f6e4bc8e0
I20260811 01:39:04.410772 29457 tablet_service.cc:1514] Processing DeleteTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:04 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:42348
I20260811 01:39:04.410902 29749 tablet_service.cc:1514] Processing DeleteTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:04 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:41436
I20260811 01:39:04.410915 29604 tablet_service.cc:1514] Processing DeleteTablet for tablet c9deb7ccfdc842178f2a643f6e4bc8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:04 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:55502
I20260811 01:39:04.411973 29872 tablet_replica.cc:330] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: stopping tablet replica
I20260811 01:39:04.412563 29872 raft_consensus.cc:2229] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:39:04.413278 29872 raft_consensus.cc:2258] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:04.413702 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 29388
I20260811 01:39:04.414415 29871 tablet_replica.cc:330] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: stopping tablet replica
I20260811 01:39:04.415278 29871 raft_consensus.cc:2229] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:39:04.417658 29872 ts_tablet_manager.cc:1905] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:39:04.418375 29871 raft_consensus.cc:2258] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:04.421201 29870 tablet_replica.cc:330] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: stopping tablet replica
I20260811 01:39:04.421746 29870 raft_consensus.cc:2229] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:39:04.422582 29870 raft_consensus.cc:2258] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:04.423018 29871 ts_tablet_manager.cc:1905] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:39:04.424746 29870 ts_tablet_manager.cc:1905] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:39:04.430728 29872 ts_tablet_manager.cc:1918] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 11 01:39:04 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:39:04.432222 29870 ts_tablet_manager.cc:1918] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:39:04.432408 29870 log.cc:1196] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/c9deb7ccfdc842178f2a643f6e4bc8e0
I20260811 01:39:04.433017 29870 ts_tablet_manager.cc:1939] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cc9d32b2adc3447b99a9236890e8bf12: Deleting consensus metadata
I20260811 01:39:04.435245 29303 catalog_manager.cc:4841] TS cc9d32b2adc3447b99a9236890e8bf12 (127.17.132.1:43081): tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (table test-table [id=0757155780dd4b6dbd9c50a81fba679f]) successfully deleted
I20260811 01:39:04.435803 29872 log.cc:1196] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/c9deb7ccfdc842178f2a643f6e4bc8e0
I20260811 01:39:04.436393 29872 ts_tablet_manager.cc:1939] T c9deb7ccfdc842178f2a643f6e4bc8e0 P 10d2de52f5d54be39b2d4f8456cb87ca: Deleting consensus metadata
I20260811 01:39:04.437367 29871 ts_tablet_manager.cc:1918] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:39:04.437594 29871 log.cc:1196] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/c9deb7ccfdc842178f2a643f6e4bc8e0
I20260811 01:39:04.438247 29871 ts_tablet_manager.cc:1939] T c9deb7ccfdc842178f2a643f6e4bc8e0 P cca197712bfb4f8c9809ed50ad3d0b93: Deleting consensus metadata
I20260811 01:39:04.438305 29302 catalog_manager.cc:4841] TS 10d2de52f5d54be39b2d4f8456cb87ca (127.17.132.2:33385): tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (table test-table [id=0757155780dd4b6dbd9c50a81fba679f]) successfully deleted
I20260811 01:39:04.440209 29302 catalog_manager.cc:4841] TS cca197712bfb4f8c9809ed50ad3d0b93 (127.17.132.3:36619): tablet c9deb7ccfdc842178f2a643f6e4bc8e0 (table test-table [id=0757155780dd4b6dbd9c50a81fba679f]) successfully deleted
I20260811 01:39:04.440790 29840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.416667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42366 (local address 127.17.132.1:43081)
0811 01:39:04.416858 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.416864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.420760 (+ 3896us) server_negotiation.cc:407] Connection header received
0811 01:39:04.421023 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.421030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.421109 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.421241 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:04.423239 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.424427 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.426265 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.427026 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.427183 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.432625 (+ 5442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:04.432641 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:04.432659 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:04.432705 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:04.437056 (+ 4351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.438102 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.438115 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.438120 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.438319 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.438842 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.438848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.438850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.439334 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:04.439638 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.440285 (+ 647us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.440537 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:39:04.442143 29524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:04.540827 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 29388
I20260811 01:39:04.563361 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 29536
Aug 11 01:39:04 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:39:04.578886 29844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.564168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55506 (local address 127.17.132.2:33385)
0811 01:39:04.564334 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.564339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.564358 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:39:04.564453 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.564457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.564529 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.564625 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:04.565906 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.566698 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.567915 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.568326 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.568424 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.572690 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:04.572708 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:04.572725 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:04.572767 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:04.575908 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.576752 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.576760 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.576762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.576902 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.577240 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.577243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.577245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.577654 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:04.578042 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.578380 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.578562 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:39:04.579595 29666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:04.670032 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 29536
I20260811 01:39:04.691522 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 29677
Aug 11 01:39:04 dist-test-slave-0kls krb5kdc[29271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:39:04.706852 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:04.692356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41452 (local address 127.17.132.3:36619)
0811 01:39:04.692548 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:04.692553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:04.692572 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:39:04.692681 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:04.692684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:04.692750 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:04.692847 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:04.694174 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.694896 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.696217 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:04.696589 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:04.696688 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:04.701292 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:04.701311 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:04.701329 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:04.701370 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:04.704178 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.704877 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.704884 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.704886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.705027 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:04.705351 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:04.705354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:04.705356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:04.705723 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:04.706166 (+ 443us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:04.706396 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:39:04.706570 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:39:04.707545 29817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:04.799093 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 29677
I20260811 01:39:04.819639 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 29285
I20260811 01:39:04.820962 29356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:04.934707 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 29285
2026-08-11T01:39:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4790 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:39:05 dist-test-slave-0kls krb5kdc[29881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:39:05 dist-test-slave-0kls krb5kdc[29881](info): set up 2 sockets
Aug 11 01:39:05 dist-test-slave-0kls krb5kdc[29881](info): commencing operation
krb5kdc: starting...
W20260811 01:39:06.143018 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.006s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:39:06 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:39:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:39:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangeradmin_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangeradmin_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangerlookup_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangerlookup_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
I20260811 01:39:06.584968 17936 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskFNFd6P/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/postgres -l logfile start
2026-08-11 01:39:09.246 UTC [29911] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:39:09.246 UTC [29911] LOG: listening on IPv4 address "127.17.132.20", port 60185
2026-08-11 01:39:09.250 UTC [29911] LOG: listening on Unix socket "/tmp/.s.PGSQL.60185"
2026-08-11 01:39:09.275 UTC [29915] LOG: database system was shut down at 2026-08-11 01:39:07 UTC
2026-08-11 01:39:09.279 UTC [29911] LOG: database system is ready to accept connections
I20260811 01:39:10.322029 17936 mini_postgres.cc:96] Postgres bound to 60185
2026-08-11 01:39:10.347 UTC [29926] FATAL: database "slave" does not exist
127.17.132.20:60185 - accepting connections
I20260811 01:39:10.348279 17936 mini_ranger.cc:161] Starting Ranger...
I20260811 01:39:10.383412 17936 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:39:10.941334 17936 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:39:10.941576 17936 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin
2026-08-11 01:39:11,428 [I] DB FLAVOR :POSTGRES
2026-08-11 01:39:11,429 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:39:11,429 [I] Checking connection..
2026-08-11 01:39:11,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:39:11,903 [I] Checking connection passed.
2026-08-11 01:39:11,903 [I] --------- Verifying version history table ---------
2026-08-11 01:39:11,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:39:12,194 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:39:12,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:39:12,444 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:39:12,444 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:39:12,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:39:12.696 UTC [29995] WARNING: there is no transaction in progress
2026-08-11 01:39:12,704 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:39:12,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:39:12,960 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:39:12,961 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:39:12,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:39:13,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:39:13,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0kls.c.gcp-upstream.internal','N') ;"
2026-08-11 01:39:13,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:39:14,022 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:39:14,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:39:14,300 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:39:14,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:39:14,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:39:14,813 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:39:14,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:39:15.848 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.865 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.883 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.898 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.914 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.933 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.992 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:15.999 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.016 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.027 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.038 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.053 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.063 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.070 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.077 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16.085 UTC [30115] WARNING: there is no transaction in progress
2026-08-11 01:39:16,810 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:39:16,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:39:17,045 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:39:17,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:39:17,310 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:39:17,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:39:17,574 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:39:17,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:39:17,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:39:18,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0kls.c.gcp-upstream.internal';"
2026-08-11 01:39:18,372 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:39:18,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:39:18,647 [I] DB_PATCHES have already been applied
I20260811 01:39:18.654132 17936 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskFNFd6P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:39:18.654320 17936 mini_ranger.cc:193] Using host: 127.17.132.20
I20260811 01:39:18.679638 17936 mini_ranger.cc:227] Ranger admin URL: http://127.17.132.20:49275
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:39:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:39:19.932621 17936 mini_ranger.cc:160] Time spent starting Ranger: real 9.584s user 0.000s sys 0.075s
Aug 11, 2026 1:39:41 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:39:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 1:39:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:39:41 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:39:42 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:39:42.844803 17936 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangerkms_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/rangerkms_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.132.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.132.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:39:43 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412383, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:39:43.075783 17936 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:39:43.104830 17936 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:39:44.022104 17936 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:39:44.022256 17936 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms
I20260811 01:39:44.022413 17936 mini_ranger_kms.cc:227] Using postgres at 127.17.132.20:60185
2026-08-11 01:39:44,597 [I] DB FLAVOR :POSTGRES
2026-08-11 01:39:44,597 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:39:44,597 [I] Checking connection
2026-08-11 01:39:44,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:39:44,856 [I] connection success
2026-08-11 01:39:44,856 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:39:44,856 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:39:44,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:39:45,102 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:39:45,103 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:39:45,103 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:39:45,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:60185/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:39:45,373 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:39:45.914235 17936 mini_ranger_kms.cc:310] Created kms service
I20260811 01:39:46.152172 17936 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:39:46.198163 17936 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:39:46 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412383, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:46.589102 17936 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:39:46.590505 17936 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms:/tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:39:46.590602 17936 mini_ranger_kms.cc:240] Using host: 127.17.132.20
I20260811 01:39:46.619802 17936 mini_ranger_kms.cc:276] Ranger KMS PID: 30309
I20260811 01:39:46.620010 17936 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.132.20:54095
Aug 11, 2026 1:39:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:39:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:39:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:39:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:39:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:39:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 01:39:48 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412388, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:49.044517 17936 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.969s user 0.127s sys 0.495s
I20260811 01:39:49.044780 17936 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:39:49.045003 17936 mini_ranger_kms.cc:401] 127.17.132.20:54095/kms/v1/keys
Aug 11 01:39:49 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412388, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
Aug 11 01:39:49 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412388, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
Aug 11 01:39:52 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:39:52.374166 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:39367
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:46143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:39367
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:54095/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:39:52.781327 30366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:52.781706 30366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:52.781858 30366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:52.789779 30366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:39:52.789953 30366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:52.790001 30366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:52.790059 30366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:39:52.790114 30366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:39:52.801043 30366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:46143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.132.20:54095/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:39367
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:39367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:52.802415 30366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:52.803730 30366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:52.817638 30375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:52.817704 30371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:52.817749 30372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:52.818710 30366 server_base.cc:1034] running on GCE node
I20260811 01:39:52.819557 30366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:52.821350 30366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:52.822633 30366 hybrid_clock.cc:648] HybridClock initialized: now 1786412392822577 us; error 49 us; skew 500 ppm
I20260811 01:39:52.823051 30366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:52 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:52.826617 30366 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:39:52.828128 30366 webserver.cc:460] Webserver started at http://127.17.132.62:41623/ using document root <none> and password file <none>
I20260811 01:39:52.828832 30366 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:52.828940 30366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:52.829219 30366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:39:52 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:52.884169 30366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "a30d2e9f408d4633be2bea77fbfdd795"
format_stamp: "Formatted at 2026-08-11 01:39:52 on dist-test-slave-0kls"
server_key: "d2c775c1555d0ee5fa360a847fa3f93d"
server_key_iv: "351d1e4fe5b8230bdbda7b548006dfc2"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:52.885394 30366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "a30d2e9f408d4633be2bea77fbfdd795"
format_stamp: "Formatted at 2026-08-11 01:39:52 on dist-test-slave-0kls"
server_key: "d2c775c1555d0ee5fa360a847fa3f93d"
server_key_iv: "351d1e4fe5b8230bdbda7b548006dfc2"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:52.892254 30366 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260811 01:39:52.911309 30382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:52.913101 30366 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:39:52.913329 30366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "a30d2e9f408d4633be2bea77fbfdd795"
format_stamp: "Formatted at 2026-08-11 01:39:52 on dist-test-slave-0kls"
server_key: "d2c775c1555d0ee5fa360a847fa3f93d"
server_key_iv: "351d1e4fe5b8230bdbda7b548006dfc2"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:52.913594 30366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:52.931453 30366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:52.936128 30366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:52.936496 30366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:52.962512 30366 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:39367
I20260811 01:39:52.962512 30440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:39367 every 8 connection(s)
I20260811 01:39:52.964288 30366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:39:52.968930 30441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:52.973649 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 30366
I20260811 01:39:52.973892 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:39:52.974730 17936 external_mini_cluster.cc:1428] Setting key f8ed5feb7f7724cfd01c20ae5589d317
I20260811 01:39:52.982775 30441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: Bootstrap starting.
I20260811 01:39:52.986896 30441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:52.988072 30441 log.cc:824] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:52.992050 30441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: No bootstrap required, opened a new log
Aug 11 01:39:52 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:53.001835 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:52.977426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45954 (local address 127.17.132.62:39367)
0811 01:39:52.978465 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:52.978483 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:52.978560 (+ 77us) server_negotiation.cc:407] Connection header received
0811 01:39:52.981129 (+ 2569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:52.981162 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:52.981722 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:52.982194 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:52.983852 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:52.986069 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:52.987927 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:52.989191 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:52.989422 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:52.993508 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:52.993516 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:52.993532 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:52.993573 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:52.996934 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:52.997717 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:52.997733 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:52.997741 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:52.997976 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:52.998645 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:52.998653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:52.998659 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:52.999295 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:52.999656 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:53.000146 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 01:39:53.000609 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":415,"threads_started":1}
I20260811 01:39:53.002023 30441 raft_consensus.cc:348] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } }
I20260811 01:39:53.002496 30441 raft_consensus.cc:374] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:53.002616 30441 raft_consensus.cc:729] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a30d2e9f408d4633be2bea77fbfdd795, State: Initialized, Role: FOLLOWER
I20260811 01:39:53.003283 30441 consensus_queue.cc:260] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } }
I20260811 01:39:53.003539 30441 raft_consensus.cc:388] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:39:53.003690 30441 raft_consensus.cc:482] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:39:53.003873 30441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:53.006707 30441 raft_consensus.cc:504] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } }
I20260811 01:39:53.007246 30441 leader_election.cc:302] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a30d2e9f408d4633be2bea77fbfdd795; no voters:
I20260811 01:39:53.007861 30441 leader_election.cc:288] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:39:53.008073 30446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:39:53.008903 30446 raft_consensus.cc:686] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [term 1 LEADER]: Becoming Leader. State: Replica: a30d2e9f408d4633be2bea77fbfdd795, State: Running, Role: LEADER
I20260811 01:39:53.009500 30446 consensus_queue.cc:237] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } }
I20260811 01:39:53.010251 30441 sys_catalog.cc:564] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:39:53.012856 30447 sys_catalog.cc:455] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a30d2e9f408d4633be2bea77fbfdd795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } } }
I20260811 01:39:53.013010 30449 sys_catalog.cc:455] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a30d2e9f408d4633be2bea77fbfdd795. Latest consensus state: current_term: 1 leader_uuid: "a30d2e9f408d4633be2bea77fbfdd795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a30d2e9f408d4633be2bea77fbfdd795" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39367 } } }
I20260811 01:39:53.013366 30447 sys_catalog.cc:458] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [sys.catalog]: This master's current role is: LEADER
I20260811 01:39:53.013459 30449 sys_catalog.cc:458] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795 [sys.catalog]: This master's current role is: LEADER
I20260811 01:39:53.016614 30454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:39:53.022325 30454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:39:53.023370 30441 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:39:53.043406 30454 catalog_manager.cc:1347] Generated new cluster ID: 5b0c00087b0245788d2c6926bf017698
I20260811 01:39:53.043579 30454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:39:53.085945 30454 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:39:53.087916 30454 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:39:53.099650 30454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: Generated new TSK 0
I20260811 01:39:53.100809 30454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:39:53.846616 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:54095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:46143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 01:39:54.322728 30491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:54.323292 30491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:54.323500 30491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:54.336018 30491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:54.336311 30491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:54.336580 30491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:39:54.353173 30491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:46143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.132.20:54095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:54.355427 30491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:54.357447 30491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:54.375449 30503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:54.375512 30502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:54.378150 30505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:54.379845 30491 server_base.cc:1034] running on GCE node
I20260811 01:39:54.380672 30491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:54.382094 30491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:54.383397 30491 hybrid_clock.cc:648] HybridClock initialized: now 1786412394383300 us; error 72 us; skew 500 ppm
I20260811 01:39:54.383823 30491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:54.388271 30491 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:39:54.390091 30491 webserver.cc:460] Webserver started at http://127.17.132.1:34575/ using document root <none> and password file <none>
I20260811 01:39:54.390878 30491 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:54.391034 30491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:54.391374 30491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:54.411187 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539"
format_stamp: "Formatted at 2026-08-11 01:39:54 on dist-test-slave-0kls"
server_key: "f0f04e191d2e895a998ce3b1ac75b3b7"
server_key_iv: "dec15570296db6a2642fe5afe2b4a2b6"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:54.412603 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539"
format_stamp: "Formatted at 2026-08-11 01:39:54 on dist-test-slave-0kls"
server_key: "f0f04e191d2e895a998ce3b1ac75b3b7"
server_key_iv: "dec15570296db6a2642fe5afe2b4a2b6"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:54.426718 30491 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.012s sys 0.000s
I20260811 01:39:54.458078 30512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:54.460376 30491 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.005s sys 0.006s
I20260811 01:39:54.460685 30491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539"
format_stamp: "Formatted at 2026-08-11 01:39:54 on dist-test-slave-0kls"
server_key: "f0f04e191d2e895a998ce3b1ac75b3b7"
server_key_iv: "dec15570296db6a2642fe5afe2b4a2b6"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:54.461066 30491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:54.502763 30491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:54.507990 30491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:54.508335 30491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:54.509550 30491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:54.514746 30491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:54.514845 30491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:54.515072 30491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:54.515153 30491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:54.656400 30491 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:43527
I20260811 01:39:54.656443 30636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:43527 every 8 connection(s)
I20260811 01:39:54.658442 30491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:39:54.666544 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 30491
I20260811 01:39:54.666759 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:39:54.667603 17936 external_mini_cluster.cc:1428] Setting key dada64333704a370b3a6c99b865f999d
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:39:54.710254 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:54.668878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:45867 (local address 127.17.132.62:39367)
0811 01:39:54.688541 (+ 19663us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:54.688548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:54.688579 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:39:54.688660 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:54.688667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:54.689015 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:54.691671 (+ 2656us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:54.691875 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:54.693151 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:54.696091 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:54.696807 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:54.698043 (+ 1236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:54.701934 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:54.701941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:54.701947 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:54.701992 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:54.705980 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:54.707091 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:54.707097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:54.707101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:54.707257 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:54.707873 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:54.707879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:54.707883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:54.708310 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:54.709370 (+ 1060us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:54.709535 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 01:39:54.709855 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19500,"thread_start_us":19859,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
I20260811 01:39:54.711760 30639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:54.667468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:39367 (local address 127.17.132.1:45867)
0811 01:39:54.668532 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:54.668594 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:54.671419 (+ 2825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:54.689643 (+ 18224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:54.689659 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:54.690474 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:54.691420 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:54.691451 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:54.693382 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:54.693389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:54.695836 (+ 2447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:54.695855 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:54.697122 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:54.697130 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:54.697455 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:54.698459 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:54.698505 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:54.701578 (+ 3073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:54.706186 (+ 4608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:54.706197 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:54.706218 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:54.706873 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:54.707407 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:54.707413 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:54.707417 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:54.707703 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:54.708488 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:54.708498 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:54.709106 (+ 608us) client_negotiation.cc:769] Sending connection context
0811 01:39:54.709445 (+ 339us) client_negotiation.cc:240] Negotiation successful
0811 01:39:54.710098 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":420,"threads_started":1}
I20260811 01:39:54.714236 30637 heartbeater.cc:347] Connected to a master server at 127.17.132.62:39367
I20260811 01:39:54.714605 30637 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:54.715521 30637 heartbeater.cc:511] Master 127.17.132.62:39367 requested a full tablet report, sending...
I20260811 01:39:54.718369 30402 ts_manager.cc:194] Registered new tserver with Master: cd6d6ecc9ad143db85d4dbe4c01fb539 (127.17.132.1:43527)
I20260811 01:39:54.720642 30402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:45867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:39:54.749882 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:54095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:46143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:39:54 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412394, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
W20260811 01:39:55.219456 30644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:55.219723 30644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:55.219936 30644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:55.227573 30644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:55.227689 30644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:55.227855 30644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:39:55.238080 30644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:46143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.132.20:54095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:55.239444 30644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:55.240854 30644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:55.254420 30660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:55.254540 30663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:55.254489 30661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:55.255796 30644 server_base.cc:1034] running on GCE node
I20260811 01:39:55.256471 30644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:55.257458 30644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:55.258687 30644 hybrid_clock.cc:648] HybridClock initialized: now 1786412395258649 us; error 30 us; skew 500 ppm
I20260811 01:39:55.259002 30644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:55 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:55.262384 30644 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:39:55.263991 30644 webserver.cc:460] Webserver started at http://127.17.132.2:38925/ using document root <none> and password file <none>
I20260811 01:39:55.264756 30644 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:55.264910 30644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:55.265280 30644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:39:55 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:55.283375 30644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "1a3d1c6017894df5a96b04b30ae4d8ba"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "6876998d958bd4194db57a315066f508"
server_key_iv: "b0cad88252d274b8fc9730c04a2d12b4"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.284361 30644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "1a3d1c6017894df5a96b04b30ae4d8ba"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "6876998d958bd4194db57a315066f508"
server_key_iv: "b0cad88252d274b8fc9730c04a2d12b4"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.290493 30644 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 01:39:55.305630 30671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:55.307333 30644 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:39:55.307539 30644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "1a3d1c6017894df5a96b04b30ae4d8ba"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "6876998d958bd4194db57a315066f508"
server_key_iv: "b0cad88252d274b8fc9730c04a2d12b4"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.307781 30644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:55.321769 30644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:55.326445 30644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:55.326886 30644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:55.327997 30644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:55.329558 30644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:55.329639 30644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:55.329836 30644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:55.329903 30644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 01:39:55.369453 30644 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:36195
I20260811 01:39:55.369546 30795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:36195 every 8 connection(s)
I20260811 01:39:55.370963 30644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:39:55.377535 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 30644
I20260811 01:39:55.377749 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:39:55.378257 17936 external_mini_cluster.cc:1428] Setting key 425cb3a7bfa1fe33679f501b7a4cdf22
Aug 11 01:39:55 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:55.398126 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:55.374237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:38179 (local address 127.17.132.62:39367)
0811 01:39:55.374813 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:55.374820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:55.375825 (+ 1005us) server_negotiation.cc:407] Connection header received
0811 01:39:55.378501 (+ 2676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:55.378507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:55.378605 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:55.378736 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:55.380697 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:55.382050 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:55.384780 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:55.385644 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:55.385830 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:55.390449 (+ 4619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:55.390456 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:55.390462 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:55.390505 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:55.394158 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:55.395195 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:55.395202 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:55.395205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:55.395353 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:55.395923 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:55.395928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:55.395931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:55.396296 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:55.396442 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:55.397436 (+ 994us) server_negotiation.cc:299] Negotiation successful
0811 01:39:55.397701 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":284,"threads_started":1}
I20260811 01:39:55.399561 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:55.374777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:39367 (local address 127.17.132.2:38179)
0811 01:39:55.375635 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:55.375694 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:55.378182 (+ 2488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:55.379001 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:55.379013 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:55.379629 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:55.380466 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:55.380490 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:55.382255 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:55.382261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:55.384610 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:55.384626 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:55.385928 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:55.385935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:55.386232 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:55.387096 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:55.387127 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:55.390155 (+ 3028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:55.394319 (+ 4164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:55.394333 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:55.394355 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:55.395059 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:55.395478 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:55.395485 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:55.395492 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:55.395794 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:55.396447 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:55.396459 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:55.396975 (+ 516us) client_negotiation.cc:769] Sending connection context
0811 01:39:55.397301 (+ 326us) client_negotiation.cc:240] Negotiation successful
0811 01:39:55.397966 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":336,"threads_started":1}
I20260811 01:39:55.401285 30796 heartbeater.cc:347] Connected to a master server at 127.17.132.62:39367
I20260811 01:39:55.401648 30796 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:55.402668 30796 heartbeater.cc:511] Master 127.17.132.62:39367 requested a full tablet report, sending...
I20260811 01:39:55.404547 30402 ts_manager.cc:194] Registered new tserver with Master: 1a3d1c6017894df5a96b04b30ae4d8ba (127.17.132.2:36195)
I20260811 01:39:55.405892 30402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:38179
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:39:55.454173 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:54095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:46143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:39:55.725270 30637 heartbeater.cc:503] Master 127.17.132.62:39367 was elected leader, sending a full tablet report...
W20260811 01:39:55.852730 30802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:39:55.853250 30802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:39:55.853550 30802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:39:55.864854 30802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:39:55.865070 30802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:39:55.865322 30802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:39:55.880440 30802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:46143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.132.20:54095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:39367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:39:55.881955 30802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:39:55.883430 30802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:39:55.901255 30809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:55.901398 30807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:39:55.901921 30811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:39:55.902662 30802 server_base.cc:1034] running on GCE node
I20260811 01:39:55.903435 30802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:39:55.904542 30802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:39:55.905844 30802 hybrid_clock.cc:648] HybridClock initialized: now 1786412395905752 us; error 68 us; skew 500 ppm
I20260811 01:39:55.906189 30802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:39:55 dist-test-slave-0kls krb5kdc[29881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:39:55.909564 30802 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:39:55.911396 30802 webserver.cc:460] Webserver started at http://127.17.132.3:45393/ using document root <none> and password file <none>
I20260811 01:39:55.912202 30802 fs_manager.cc:359] Metadata directory not provided
I20260811 01:39:55.912359 30802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:39:55.912755 30802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:39:55 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:39:55.929441 30802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "0cfbf042c9994d67bb191d8d1fd2936e"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "685846ad36ff6603d34226279a44f1e5"
server_key_iv: "cc305061a1c3005e493b3e65b6775751"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.930464 30802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "0cfbf042c9994d67bb191d8d1fd2936e"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "685846ad36ff6603d34226279a44f1e5"
server_key_iv: "cc305061a1c3005e493b3e65b6775751"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.937265 30802 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 01:39:55.953401 30819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:55.955020 30802 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:39:55.955237 30802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "0cfbf042c9994d67bb191d8d1fd2936e"
format_stamp: "Formatted at 2026-08-11 01:39:55 on dist-test-slave-0kls"
server_key: "685846ad36ff6603d34226279a44f1e5"
server_key_iv: "cc305061a1c3005e493b3e65b6775751"
server_key_version: "kuduclusterkey@0"
I20260811 01:39:55.955487 30802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:39:55.979290 30802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:39:55.983852 30802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:39:55.984200 30802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:39:55.985239 30802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:39:55.986955 30802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:39:55.987078 30802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:55.987233 30802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:39:55.987309 30802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:39:56.032902 30802 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:38755
I20260811 01:39:56.032946 30946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:38755 every 8 connection(s)
I20260811 01:39:56.034322 30802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:39:56.037315 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 30802
I20260811 01:39:56.037488 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:39:56.038065 17936 external_mini_cluster.cc:1428] Setting key 42726c871cd54c29f9680c0db06edbcf
Aug 11 01:39:56 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412395, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:39:56.056239 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.037056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:52079 (local address 127.17.132.62:39367)
0811 01:39:56.037645 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.037650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.039134 (+ 1484us) server_negotiation.cc:407] Connection header received
0811 01:39:56.041309 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.041315 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.041417 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.041523 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:56.043162 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.043886 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.045461 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.046002 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.046106 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.049642 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:56.049647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:56.049650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:56.049684 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:56.052753 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.053817 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.053822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.053826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.054011 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.054590 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.054594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.054596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.054945 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:56.055069 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.055788 (+ 719us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.055970 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":304,"threads_started":1}
I20260811 01:39:56.057241 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.037709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:39367 (local address 127.17.132.3:52079)
0811 01:39:56.038584 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.038627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.040931 (+ 2304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.041908 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.041917 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.042378 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:39:56.042974 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.042991 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.044034 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.044038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.045307 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.045320 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.046223 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.046228 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.046422 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.047232 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:39:56.047256 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:39:56.049400 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:39:56.052949 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:56.052962 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:56.052982 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:56.053613 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:56.054153 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:39:56.054159 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:39:56.054162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:39:56.054451 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:39:56.055079 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:39:56.055085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:39:56.055429 (+ 344us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.055696 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.056109 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":377,"threads_started":1}
I20260811 01:39:56.058676 30947 heartbeater.cc:347] Connected to a master server at 127.17.132.62:39367
I20260811 01:39:56.058998 30947 heartbeater.cc:464] Registering TS with master...
I20260811 01:39:56.059881 30947 heartbeater.cc:511] Master 127.17.132.62:39367 requested a full tablet report, sending...
I20260811 01:39:56.061388 30402 ts_manager.cc:194] Registered new tserver with Master: 0cfbf042c9994d67bb191d8d1fd2936e (127.17.132.3:38755)
I20260811 01:39:56.062340 30402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:52079
I20260811 01:39:56.067663 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:39:56.086099 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.072768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45968 (local address 127.17.132.62:39367)
0811 01:39:56.072953 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.072958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.073499 (+ 541us) server_negotiation.cc:407] Connection header received
0811 01:39:56.073644 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.073648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.073729 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.073910 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:56.075386 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.076128 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.077434 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.077933 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.078027 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.080661 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:56.080666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:56.080669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:56.080701 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:56.083514 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.084209 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.084213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.084215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.084332 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.084689 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.084692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.084694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.084950 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:56.085122 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.085496 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.085686 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:39:56.090400 30402 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:39:56.099156 30402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:39:56.126633 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.113048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35160)
0811 01:39:56.114212 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.114254 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.114421 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.115798 (+ 1377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.115807 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.115843 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:56.116493 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.116512 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.119144 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.119153 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.122265 (+ 3112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.122288 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.125240 (+ 2952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.125250 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.125547 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.125621 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.125811 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.126044 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"thread_start_us":738,"threads_started":1}
I20260811 01:39:56.127537 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.113358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.17.132.1:43527)
0811 01:39:56.114880 (+ 1522us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.114887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.114909 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:39:56.114988 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.114994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.115273 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.115484 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:56.116729 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.118924 (+ 2195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.122517 (+ 3593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.124535 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.124718 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.125040 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.126966 (+ 1926us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.127172 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1376,"thread_start_us":1217,"threads_started":1}
I20260811 01:39:56.132342 30568 tablet_service.cc:1467] Processing CreateTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d (DEFAULT_TABLE table=test-table [id=80e1b77419304fc58e946e06ad57df69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:56.134215 30568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f73a3b426b4190b5fcbdaa06ddad1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:56.135546 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.115935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.17.132.3:38755)
0811 01:39:56.126167 (+ 10232us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.126175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.127912 (+ 1737us) server_negotiation.cc:407] Connection header received
0811 01:39:56.128310 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.128320 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.128566 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.128853 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:56.129916 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.131188 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.133255 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.134436 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.134607 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.134853 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.135055 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.135212 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10048,"thread_start_us":9846,"threads_started":1}
I20260811 01:39:56.135615 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.115368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:38755 (local address 127.0.0.1:34966)
0811 01:39:56.126767 (+ 11399us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.126783 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.126904 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.128858 (+ 1954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.128863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.128897 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:56.129675 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.129700 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.131346 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.131354 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.133083 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.133096 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.134653 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.134659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.134834 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.134869 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.135000 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.135154 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11254,"mutex_wait_us":3,"thread_start_us":11075,"threads_started":1}
I20260811 01:39:56.136359 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.113088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:36195 (local address 127.0.0.1:56630)
0811 01:39:56.126071 (+ 12983us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.126091 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.126262 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.128019 (+ 1757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.128027 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.128062 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:56.128818 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.128834 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.130649 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.130655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.132810 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.132826 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.135490 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.135497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.135721 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.135757 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.135856 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.135988 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12831,"mutex_wait_us":1,"thread_start_us":13278,"threads_started":1}
I20260811 01:39:56.136853 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.113999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56630 (local address 127.17.132.2:36195)
0811 01:39:56.125310 (+ 11311us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.125323 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.126248 (+ 925us) server_negotiation.cc:407] Connection header received
0811 01:39:56.127456 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.127471 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.127777 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.128018 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:56.129059 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.130493 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.133032 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.134984 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.135125 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.135309 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.135928 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.136119 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11062,"thread_start_us":11326,"threads_started":1}
I20260811 01:39:56.139685 30876 tablet_service.cc:1467] Processing CreateTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d (DEFAULT_TABLE table=test-table [id=80e1b77419304fc58e946e06ad57df69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:56.140651 30725 tablet_service.cc:1467] Processing CreateTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d (DEFAULT_TABLE table=test-table [id=80e1b77419304fc58e946e06ad57df69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:39:56.141746 30876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f73a3b426b4190b5fcbdaa06ddad1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:56.142306 30725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f73a3b426b4190b5fcbdaa06ddad1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:39:56.148909 30968 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Bootstrap starting.
I20260811 01:39:56.152436 30968 tablet_bootstrap.cc:654] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:56.154065 30968 log.cc:824] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:56.157017 30968 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: No bootstrap required, opened a new log
I20260811 01:39:56.157346 30968 ts_tablet_manager.cc:1397] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 01:39:56.158656 30971 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Bootstrap starting.
I20260811 01:39:56.159547 30972 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Bootstrap starting.
I20260811 01:39:56.163555 30972 tablet_bootstrap.cc:654] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:56.164739 30971 tablet_bootstrap.cc:654] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Neither blocks nor log segments found. Creating new log.
I20260811 01:39:56.164958 30972 log.cc:824] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:56.166097 30971 log.cc:824] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:39:56.168676 30972 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: No bootstrap required, opened a new log
I20260811 01:39:56.169039 30972 ts_tablet_manager.cc:1397] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:39:56.168972 30968 raft_consensus.cc:348] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.169502 30968 raft_consensus.cc:374] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:56.169652 30968 raft_consensus.cc:729] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6d6ecc9ad143db85d4dbe4c01fb539, State: Initialized, Role: FOLLOWER
I20260811 01:39:56.169895 30971 tablet_bootstrap.cc:492] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: No bootstrap required, opened a new log
I20260811 01:39:56.170241 30971 ts_tablet_manager.cc:1397] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260811 01:39:56.170531 30968 consensus_queue.cc:260] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.174063 30968 ts_tablet_manager.cc:1428] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Time spent starting tablet: real 0.017s user 0.008s sys 0.008s
I20260811 01:39:56.179380 30972 raft_consensus.cc:348] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.179822 30972 raft_consensus.cc:374] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:56.179936 30972 raft_consensus.cc:729] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3d1c6017894df5a96b04b30ae4d8ba, State: Initialized, Role: FOLLOWER
I20260811 01:39:56.179896 30971 raft_consensus.cc:348] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.180354 30971 raft_consensus.cc:374] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:39:56.180470 30971 raft_consensus.cc:729] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfbf042c9994d67bb191d8d1fd2936e, State: Initialized, Role: FOLLOWER
I20260811 01:39:56.180631 30972 consensus_queue.cc:260] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.181099 30971 consensus_queue.cc:260] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.182096 30796 heartbeater.cc:503] Master 127.17.132.62:39367 was elected leader, sending a full tablet report...
I20260811 01:39:56.182510 30972 ts_tablet_manager.cc:1428] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Time spent starting tablet: real 0.013s user 0.005s sys 0.007s
I20260811 01:39:56.183322 30947 heartbeater.cc:503] Master 127.17.132.62:39367 was elected leader, sending a full tablet report...
I20260811 01:39:56.184149 30971 ts_tablet_manager.cc:1428] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
W20260811 01:39:56.286269 30948 tablet.cc:2369] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:39:56.316570 30976 raft_consensus.cc:482] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:39:56.316895 30976 raft_consensus.cc:504] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.318899 30976 leader_election.cc:288] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd6d6ecc9ad143db85d4dbe4c01fb539 (127.17.132.1:43527), 0cfbf042c9994d67bb191d8d1fd2936e (127.17.132.3:38755)
I20260811 01:39:56.326272 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.319554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:60749 (local address 127.17.132.1:43527)
0811 01:39:56.319833 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.319842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.320018 (+ 176us) server_negotiation.cc:407] Connection header received
0811 01:39:56.320379 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.320388 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.320471 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.320527 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:56.321340 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.322480 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.324470 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.325264 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.325459 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.325542 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.325875 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.326004 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:39:56.326409 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.319122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.17.132.2:60749)
0811 01:39:56.319867 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.319895 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.320153 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.320693 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.320697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.320720 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:56.321121 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.321130 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.322628 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.322634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.324308 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.324321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.325499 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.325505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.325675 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.325700 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.325844 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.325992 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":362,"threads_started":1}
I20260811 01:39:56.326805 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.320123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:46367 (local address 127.17.132.3:38755)
0811 01:39:56.320361 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.320366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.321241 (+ 875us) server_negotiation.cc:407] Connection header received
0811 01:39:56.321365 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.321374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.321463 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.321559 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:39:56.322244 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.323257 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.324938 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.325748 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.325982 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.326058 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.326430 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.326555 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:39:56.326846 30979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.319981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:38755 (local address 127.17.132.2:46367)
0811 01:39:56.321122 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.321138 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:39:56.321248 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:39:56.321580 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:39:56.321583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:39:56.321604 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:39:56.322003 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.322015 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.323409 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.323414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.324774 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:39:56.324785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.326006 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.326012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:39:56.326250 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.326273 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:39:56.326389 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:39:56.326521 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":756,"threads_started":1}
I20260811 01:39:56.327927 30897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f73a3b426b4190b5fcbdaa06ddad1d" candidate_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" is_pre_election: true
I20260811 01:39:56.327927 30590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f73a3b426b4190b5fcbdaa06ddad1d" candidate_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" is_pre_election: true
I20260811 01:39:56.328464 30590 raft_consensus.cc:2454] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3d1c6017894df5a96b04b30ae4d8ba in term 0.
I20260811 01:39:56.328462 30897 raft_consensus.cc:2454] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3d1c6017894df5a96b04b30ae4d8ba in term 0.
I20260811 01:39:56.329159 30673 leader_election.cc:302] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfbf042c9994d67bb191d8d1fd2936e, 1a3d1c6017894df5a96b04b30ae4d8ba; no voters:
I20260811 01:39:56.329571 30976 raft_consensus.cc:2781] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:39:56.329732 30976 raft_consensus.cc:482] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:39:56.329876 30976 raft_consensus.cc:3037] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:56.332173 30976 raft_consensus.cc:504] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.332796 30976 leader_election.cc:288] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [CANDIDATE]: Term 1 election: Requested vote from peers cd6d6ecc9ad143db85d4dbe4c01fb539 (127.17.132.1:43527), 0cfbf042c9994d67bb191d8d1fd2936e (127.17.132.3:38755)
I20260811 01:39:56.333258 30590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f73a3b426b4190b5fcbdaa06ddad1d" candidate_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539"
I20260811 01:39:56.333348 30897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f73a3b426b4190b5fcbdaa06ddad1d" candidate_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfbf042c9994d67bb191d8d1fd2936e"
I20260811 01:39:56.333477 30590 raft_consensus.cc:3037] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:56.333595 30897 raft_consensus.cc:3037] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:39:56.335950 30897 raft_consensus.cc:2454] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3d1c6017894df5a96b04b30ae4d8ba in term 1.
I20260811 01:39:56.335945 30590 raft_consensus.cc:2454] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3d1c6017894df5a96b04b30ae4d8ba in term 1.
I20260811 01:39:56.336370 30673 leader_election.cc:302] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfbf042c9994d67bb191d8d1fd2936e, 1a3d1c6017894df5a96b04b30ae4d8ba; no voters:
I20260811 01:39:56.336658 30976 raft_consensus.cc:2781] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:39:56.337162 30976 raft_consensus.cc:686] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 1 LEADER]: Becoming Leader. State: Replica: 1a3d1c6017894df5a96b04b30ae4d8ba, State: Running, Role: LEADER
I20260811 01:39:56.337670 30976 consensus_queue.cc:237] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } }
I20260811 01:39:56.342808 30401 catalog_manager.cc:5495] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3d1c6017894df5a96b04b30ae4d8ba (127.17.132.2). New cstate: current_term: 1 leader_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3d1c6017894df5a96b04b30ae4d8ba" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 36195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 } health_report { overall_health: UNKNOWN } } }
W20260811 01:39:56.373289 30797 tablet.cc:2369] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:39:56.383832 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.377421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56640 (local address 127.17.132.2:36195)
0811 01:39:56.377653 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.377658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.377678 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:39:56.377931 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.377934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.378019 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.378145 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:39:56.378551 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.379452 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.381496 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.381996 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.382100 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.382718 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:39:56.383181 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:39:56.383298 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.383421 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.383487 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:39:56.392380 30897 raft_consensus.cc:1261] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 1 FOLLOWER]: Refusing update from remote peer 1a3d1c6017894df5a96b04b30ae4d8ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:39:56.392517 30590 raft_consensus.cc:1261] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 1 FOLLOWER]: Refusing update from remote peer 1a3d1c6017894df5a96b04b30ae4d8ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:39:56.393471 30980 consensus_queue.cc:1035] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfbf042c9994d67bb191d8d1fd2936e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 38755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:39:56.393920 30976 consensus_queue.cc:1035] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd6d6ecc9ad143db85d4dbe4c01fb539" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 43527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:39:56.407313 30985 mvcc.cc:205] Tried to move back new op lower bound from 7317145175613063168 to 7317145175403409408. Current Snapshot: MvccSnapshot[applied={T|T < 7317145175613063168}]
I20260811 01:39:56.422091 30401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:39:56.422395 30401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:39:56.426713 30401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a30d2e9f408d4633be2bea77fbfdd795: Sending DeleteTablet for 3 replicas of tablet 03f73a3b426b4190b5fcbdaa06ddad1d
I20260811 01:39:56.427946 30725 tablet_service.cc:1514] Processing DeleteTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:56 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56630
I20260811 01:39:56.427946 30568 tablet_service.cc:1514] Processing DeleteTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:56 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:35160
I20260811 01:39:56.428154 30876 tablet_service.cc:1514] Processing DeleteTablet for tablet 03f73a3b426b4190b5fcbdaa06ddad1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:39:56 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:34966
I20260811 01:39:56.434067 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 30491
I20260811 01:39:56.447508 30997 tablet_replica.cc:330] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: stopping tablet replica
I20260811 01:39:56.448158 30997 raft_consensus.cc:2229] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:39:56.448839 30997 raft_consensus.cc:2258] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:56.450084 30994 tablet_replica.cc:330] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: stopping tablet replica
I20260811 01:39:56.450716 30994 raft_consensus.cc:2229] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:39:56.451520 30994 raft_consensus.cc:2258] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:56.452019 30997 ts_tablet_manager.cc:1905] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 01:39:56 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:39:56.453838 30994 ts_tablet_manager.cc:1905] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:39:56.459487 30997 ts_tablet_manager.cc:1918] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:39:56.459623 30996 tablet_replica.cc:330] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: stopping tablet replica
I20260811 01:39:56.459697 30997 log.cc:1196] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/03f73a3b426b4190b5fcbdaa06ddad1d
I20260811 01:39:56.460281 30997 ts_tablet_manager.cc:1939] T 03f73a3b426b4190b5fcbdaa06ddad1d P 0cfbf042c9994d67bb191d8d1fd2936e: Deleting consensus metadata
I20260811 01:39:56.460240 30996 raft_consensus.cc:2229] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:39:56.460901 30996 raft_consensus.cc:2258] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:39:56.462764 30383 catalog_manager.cc:4841] TS 0cfbf042c9994d67bb191d8d1fd2936e (127.17.132.3:38755): tablet 03f73a3b426b4190b5fcbdaa06ddad1d (table test-table [id=80e1b77419304fc58e946e06ad57df69]) successfully deleted
I20260811 01:39:56.463618 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.435519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35172 (local address 127.17.132.1:43527)
0811 01:39:56.435746 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.435752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.437568 (+ 1816us) server_negotiation.cc:407] Connection header received
0811 01:39:56.438350 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.438357 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.438441 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.438516 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:56.442367 (+ 3851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.443608 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.446970 (+ 3362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.447689 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.447815 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.453946 (+ 6131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:56.453968 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:56.453988 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:56.454047 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:56.458250 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.459367 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.459383 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.459386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.459575 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.460493 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.460499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.460505 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.461100 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:56.461442 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.462888 (+ 1446us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.463223 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:39:56.464408 30996 ts_tablet_manager.cc:1905] T 03f73a3b426b4190b5fcbdaa06ddad1d P cd6d6ecc9ad143db85d4dbe4c01fb539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:39:56.464646 30632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:56.466670 30994 ts_tablet_manager.cc:1918] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:39:56.467175 30994 log.cc:1196] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/03f73a3b426b4190b5fcbdaa06ddad1d
I20260811 01:39:56.468745 30994 ts_tablet_manager.cc:1939] T 03f73a3b426b4190b5fcbdaa06ddad1d P 1a3d1c6017894df5a96b04b30ae4d8ba: Deleting consensus metadata
I20260811 01:39:56.471380 30387 catalog_manager.cc:4841] TS 1a3d1c6017894df5a96b04b30ae4d8ba (127.17.132.2:36195): tablet 03f73a3b426b4190b5fcbdaa06ddad1d (table test-table [id=80e1b77419304fc58e946e06ad57df69]) successfully deleted
I20260811 01:39:56.556501 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 30491
I20260811 01:39:56.578450 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 30644
W20260811 01:39:56.578552 30383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:43527 (error 108)
I20260811 01:39:56.581254 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.580749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35186)
0811 01:39:56.580950 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.581077 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 01:39:56.581557 30383 catalog_manager.cc:4584] TS cd6d6ecc9ad143db85d4dbe4c01fb539 (127.17.132.1:43527): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03f73a3b426b4190b5fcbdaa06ddad1d: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Aug 11 01:39:56 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:39:56.597254 30965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.579868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56646 (local address 127.17.132.2:36195)
0811 01:39:56.580063 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.580069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.580090 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:39:56.580165 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.580170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.580258 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.580377 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:56.582294 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.583550 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.584804 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.585460 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.585598 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.589939 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:56.589958 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:56.589980 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:56.590026 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:56.594104 (+ 4078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.594833 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.594842 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.594846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.595028 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.595416 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.595422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.595426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.595920 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:56.596287 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.596595 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.596846 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:39:56.598165 30790 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:56.635511 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.634957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35200)
0811 01:39:56.635196 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.635309 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 01:39:56.636636 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.636243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35210)
0811 01:39:56.636394 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.636480 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 01:39:56.697221 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.696662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35220)
0811 01:39:56.696879 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.696986 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 01:39:56.698340 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.697987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35234)
0811 01:39:56.698141 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.698221 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 01:39:56.715684 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 30644
I20260811 01:39:56.738494 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 30802
Aug 11 01:39:56 dist-test-slave-0kls krb5kdc[29881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:39:56.760623 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.739222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34972 (local address 127.17.132.3:38755)
0811 01:39:56.739395 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 01:39:56.739400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:39:56.739435 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:39:56.739607 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:39:56.739611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:39:56.739678 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:39:56.739777 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:39:56.741045 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.741829 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.743311 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:39:56.743762 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:39:56.743885 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:39:56.748542 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:39:56.748560 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:39:56.748579 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:39:56.748626 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:39:56.757638 (+ 9012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.758475 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.758515 (+ 40us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.758520 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.758700 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:39:56.759076 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:39:56.759084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:39:56.759088 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:39:56.759552 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:39:56.759867 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 01:39:56.760074 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 01:39:56.760303 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:39:56.761350 30940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:56.779080 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.778609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35238)
0811 01:39:56.778811 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.778904 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 01:39:56.780136 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:56.779726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35246)
0811 01:39:56.779955 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:56.780024 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 01:39:56.852586 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 30802
I20260811 01:39:56.872617 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 30366
I20260811 01:39:56.874015 30435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:39:57.008836 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:39:57.008172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:43527 (local address 127.0.0.1:35260)
0811 01:39:57.008515 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 01:39:57.008622 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:43527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260811 01:39:57.008846 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 30366
I20260811 01:39:57.035442 17936 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:39:57.381490 17936 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:39:57.381826 17936 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:39:57.728006 17936 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:39:57.728 UTC [29911] LOG: received smart shutdown request
2026-08-11 01:39:57.732 UTC [29911] LOG: background worker "logical replication launcher" (PID 29924) exited with exit code 1
2026-08-11 01:39:57.732 UTC [29916] LOG: shutting down
2026-08-11 01:39:57.919 UTC [29911] LOG: database system is shut down
2026-08-11T01:39:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53116 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:39:58 dist-test-slave-0kls krb5kdc[31013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:39:58 dist-test-slave-0kls krb5kdc[31013](info): set up 2 sockets
Aug 11 01:39:58 dist-test-slave-0kls krb5kdc[31013](info): commencing operation
krb5kdc: starting...
W20260811 01:39:59.229198 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:39:59 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:39:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:39:59Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangeradmin_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangeradmin_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangerlookup_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangerlookup_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
I20260811 01:39:59.646543 17936 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskFNFd6P/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/postgres -l logfile start
2026-08-11 01:40:02.314 UTC [31047] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:40:02.314 UTC [31047] LOG: listening on IPv4 address "127.17.132.20", port 55615
2026-08-11 01:40:02.318 UTC [31047] LOG: listening on Unix socket "/tmp/.s.PGSQL.55615"
2026-08-11 01:40:02.344 UTC [31051] LOG: database system was shut down at 2026-08-11 01:40:00 UTC
2026-08-11 01:40:02.347 UTC [31047] LOG: database system is ready to accept connections
I20260811 01:40:03.379123 17936 mini_postgres.cc:96] Postgres bound to 55615
2026-08-11 01:40:03.403 UTC [31059] FATAL: database "slave" does not exist
127.17.132.20:55615 - accepting connections
I20260811 01:40:03.403680 17936 mini_ranger.cc:161] Starting Ranger...
I20260811 01:40:03.436416 17936 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:40:03.954284 17936 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:40:03.954427 17936 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin
2026-08-11 01:40:04,254 [I] DB FLAVOR :POSTGRES
2026-08-11 01:40:04,254 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:40:04,254 [I] Checking connection..
2026-08-11 01:40:04,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:40:04,492 [I] Checking connection passed.
2026-08-11 01:40:04,493 [I] --------- Verifying version history table ---------
2026-08-11 01:40:04,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:40:04,767 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:40:04,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:40:05,045 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:40:05,045 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:40:05,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:40:05.316 UTC [31128] WARNING: there is no transaction in progress
2026-08-11 01:40:05,324 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:40:05,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:40:05,600 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:40:05,600 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:40:05,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:40:05,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:40:06,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0kls.c.gcp-upstream.internal','N') ;"
2026-08-11 01:40:06,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:40:06,613 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:40:06,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:40:06,891 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:40:06,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:40:07,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:40:07,433 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:40:07,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:40:08.446 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.462 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.478 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.494 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.511 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.529 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.587 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.594 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.609 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.620 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.630 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.646 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.656 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.663 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.671 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:08.679 UTC [31253] WARNING: there is no transaction in progress
2026-08-11 01:40:09,376 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:40:09,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:40:09,628 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:40:09,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:40:09,898 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:40:09,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:40:10,177 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:40:10,177 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:40:10,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:40:10,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0kls.c.gcp-upstream.internal';"
2026-08-11 01:40:10,999 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:40:11,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:40:11,271 [I] DB_PATCHES have already been applied
I20260811 01:40:11.277469 17936 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskFNFd6P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:40:11.277619 17936 mini_ranger.cc:193] Using host: 127.17.132.20
I20260811 01:40:11.298954 17936 mini_ranger.cc:227] Ranger admin URL: http://127.17.132.20:47227
Aug 11, 2026 1:40:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:40:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:40:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:40:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:40:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:40:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:40:12 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:40:12.502393 17936 mini_ranger.cc:160] Time spent starting Ranger: real 9.099s user 0.002s sys 0.062s
Aug 11, 2026 1:40:34 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:40:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 1:40:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:40:34 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:40:35 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:40:35.896376 17936 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.132.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.132.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangerkms_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.132.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/rangerkms_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.132.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.132.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.132.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/HTTP_127.17.132.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:40:36 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412436, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:40:36.113857 17936 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:40:36.143639 17936 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:40:37.157104 17936 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:40:37.157258 17936 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms
I20260811 01:40:37.157312 17936 mini_ranger_kms.cc:227] Using postgres at 127.17.132.20:55615
2026-08-11 01:40:37,556 [I] DB FLAVOR :POSTGRES
2026-08-11 01:40:37,556 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:40:37,556 [I] Checking connection
2026-08-11 01:40:37,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:40:37,798 [I] connection success
2026-08-11 01:40:37,799 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:40:37,799 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:40:37,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:40:38,078 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:40:38,078 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:40:38,079 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:40:38,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.132.20:55615/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:40:38,397 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:40:38.924706 17936 mini_ranger_kms.cc:310] Created kms service
I20260811 01:40:39.135967 17936 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:40:39.185525 17936 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:40:39 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412436, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:39.607211 17936 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:40:39.607599 17936 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms:/tmp/dist-test-taskFNFd6P/build/asan/bin/postgresql.jar:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskFNFd6P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:40:39.607666 17936 mini_ranger_kms.cc:240] Using host: 127.17.132.20
I20260811 01:40:39.637507 17936 mini_ranger_kms.cc:276] Ranger KMS PID: 31453
I20260811 01:40:39.637684 17936 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.132.20:51121
Aug 11, 2026 1:40:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:40:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:40:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:40:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:40:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:40:41 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 01:40:42.106897 17936 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.993s user 0.099s sys 0.337s
I20260811 01:40:42.107192 17936 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:40:42.107414 17936 mini_ranger_kms.cc:401] 127.17.132.20:51121/kms/v1/keys
Aug 11 01:40:42 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 01:40:42 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
Aug 11 01:40:42 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.132.20@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
Aug 11 01:40:45 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:40:45.930339 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34761
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34761
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:40:46.341464 31511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:46.341970 31511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:46.342142 31511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:46.350284 31511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:40:46.350423 31511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:46.350509 31511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:46.350605 31511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:40:46.350678 31511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:40:46.362329 31511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.132.20:51121/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34761
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:46.363832 31511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:46.365303 31511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:46.379005 31518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:46.378924 31520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:46.378902 31517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:46.380370 31511 server_base.cc:1034] running on GCE node
I20260811 01:40:46.381368 31511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:46.383165 31511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:46.384411 31511 hybrid_clock.cc:648] HybridClock initialized: now 1786412446384362 us; error 51 us; skew 500 ppm
I20260811 01:40:46.384848 31511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:46 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412446, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:46.392432 31511 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:40:46.394261 31511 webserver.cc:460] Webserver started at http://127.17.132.62:34393/ using document root <none> and password file <none>
I20260811 01:40:46.394980 31511 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:46.395089 31511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:46.395378 31511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:40:46 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412446, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:46.455493 31511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "956ebfc532b84d528a64015767074135"
format_stamp: "Formatted at 2026-08-11 01:40:46 on dist-test-slave-0kls"
server_key: "e22b94b546a7bf29af500d39c6aae9ff"
server_key_iv: "7ae298f103933b387cc7af7752c757d9"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:46.456384 31511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "956ebfc532b84d528a64015767074135"
format_stamp: "Formatted at 2026-08-11 01:40:46 on dist-test-slave-0kls"
server_key: "e22b94b546a7bf29af500d39c6aae9ff"
server_key_iv: "7ae298f103933b387cc7af7752c757d9"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:46.462329 31511 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:40:46.484736 31527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:46.486553 31511 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:40:46.486781 31511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "956ebfc532b84d528a64015767074135"
format_stamp: "Formatted at 2026-08-11 01:40:46 on dist-test-slave-0kls"
server_key: "e22b94b546a7bf29af500d39c6aae9ff"
server_key_iv: "7ae298f103933b387cc7af7752c757d9"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:46.487025 31511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:46.517688 31511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:46.522164 31511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:46.522507 31511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:46.542706 31511 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34761
I20260811 01:40:46.542730 31584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34761 every 8 connection(s)
I20260811 01:40:46.544239 31511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:40:46.548151 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:46.552783 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 31511
I20260811 01:40:46.553036 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:40:46.553712 17936 external_mini_cluster.cc:1428] Setting key c801be9f6c8d9503857a2713ec80c3d5
I20260811 01:40:46.559870 31585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Bootstrap starting.
I20260811 01:40:46.564069 31585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:46.565325 31585 log.cc:824] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:46.568500 31585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: No bootstrap required, opened a new log
Aug 11 01:40:46 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:46.578467 31585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:46.578724 31588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:46.555835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.17.132.62:34761)
0811 01:40:46.556737 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:46.556760 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:46.556807 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:40:46.558701 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:46.558728 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:46.559164 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:46.559511 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:46.561541 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:46.562993 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:46.564868 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:46.565668 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:46.565919 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:46.570369 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:46.570377 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:46.570392 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:46.570431 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:46.574306 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:46.575261 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:46.575269 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:46.575275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:46.575436 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:46.575865 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:46.575868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:46.575870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:46.576477 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:46.576711 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:46.577228 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 01:40:46.577596 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":412,"threads_started":1}
I20260811 01:40:46.578859 31585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:46.578965 31585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 956ebfc532b84d528a64015767074135, State: Initialized, Role: FOLLOWER
I20260811 01:40:46.579545 31585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:46.579813 31585 raft_consensus.cc:388] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:40:46.580036 31585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:40:46.580271 31585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:46.583117 31585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:46.583636 31585 leader_election.cc:302] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 956ebfc532b84d528a64015767074135; no voters:
I20260811 01:40:46.584201 31585 leader_election.cc:288] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:40:46.584349 31590 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:40:46.585662 31590 raft_consensus.cc:686] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 LEADER]: Becoming Leader. State: Replica: 956ebfc532b84d528a64015767074135, State: Running, Role: LEADER
I20260811 01:40:46.586279 31590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:46.586571 31585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:40:46.589093 31592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 956ebfc532b84d528a64015767074135. Latest consensus state: current_term: 1 leader_uuid: "956ebfc532b84d528a64015767074135" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } } }
I20260811 01:40:46.589272 31591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "956ebfc532b84d528a64015767074135" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } } }
I20260811 01:40:46.589584 31592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:46.589583 31591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:46.591964 31600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:40:46.597352 31600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:40:46.598328 31585 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:40:46.621192 31600 catalog_manager.cc:1347] Generated new cluster ID: 679c4a27a28a4b9eba5071faf86929ab
I20260811 01:40:46.621450 31600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:40:46.636788 31600 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:40:46.639101 31600 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:40:46.650044 31600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Generated new TSK 0
I20260811 01:40:46.651386 31600 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:40:47.492334 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:40:47 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412447, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 01:40:48.061847 31634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:48.062373 31634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:48.062623 31634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:48.076875 31634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:48.077324 31634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:48.077913 31634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:40:48.096506 31634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:48.099045 31634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:48.101423 31634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:48.124238 31645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:48.124202 31646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:48.124907 31648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:48.125653 31634 server_base.cc:1034] running on GCE node
I20260811 01:40:48.126551 31634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:48.127833 31634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:48.129187 31634 hybrid_clock.cc:648] HybridClock initialized: now 1786412448129108 us; error 74 us; skew 500 ppm
I20260811 01:40:48.129668 31634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:48 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412448, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:48.134740 31634 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:40:48.136791 31634 webserver.cc:460] Webserver started at http://127.17.132.1:40317/ using document root <none> and password file <none>
I20260811 01:40:48.137728 31634 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:48.137967 31634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:48.138377 31634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:40:48 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412448, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:48.164291 31634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "408018b9da51414fa9e263faadd1ae00"
format_stamp: "Formatted at 2026-08-11 01:40:48 on dist-test-slave-0kls"
server_key: "a63230cf6983da25d9f8b8982758a757"
server_key_iv: "aa4b626404557f87bde768765becf4c3"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:48.169514 31634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "408018b9da51414fa9e263faadd1ae00"
format_stamp: "Formatted at 2026-08-11 01:40:48 on dist-test-slave-0kls"
server_key: "a63230cf6983da25d9f8b8982758a757"
server_key_iv: "aa4b626404557f87bde768765becf4c3"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:48.189821 31634 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.006s sys 0.012s
I20260811 01:40:48.225549 31657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:48.228482 31634 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.006s sys 0.000s
I20260811 01:40:48.228889 31634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "408018b9da51414fa9e263faadd1ae00"
format_stamp: "Formatted at 2026-08-11 01:40:48 on dist-test-slave-0kls"
server_key: "a63230cf6983da25d9f8b8982758a757"
server_key_iv: "aa4b626404557f87bde768765becf4c3"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:48.229355 31634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:48.266000 31634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:48.272975 31634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:48.273494 31634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:48.275353 31634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:48.277957 31634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:48.278149 31634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:48.278380 31634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:48.278534 31634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:40:48 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412447, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:48.466868 31634 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42277
I20260811 01:40:48.467718 31778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42277 every 8 connection(s)
I20260811 01:40:48.468879 31634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:40:48.476665 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 31634
I20260811 01:40:48.476933 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:40:48.477882 17936 external_mini_cluster.cc:1428] Setting key 8c181ae543a9f00ff3d292b20d728d7d
Aug 11 01:40:48 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412448, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:48.513093 31781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:48.472513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:55065 (local address 127.17.132.62:34761)
0811 01:40:48.490251 (+ 17738us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:48.490260 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:48.490290 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:40:48.491893 (+ 1603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:48.491899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:48.492063 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:48.492155 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:48.495097 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:48.496310 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:48.498949 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:48.499635 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:48.499740 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:48.505090 (+ 5350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:48.505099 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:48.505103 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:48.505152 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:48.508944 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:48.510133 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:48.510139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:48.510143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:48.510304 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:48.510879 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:48.510884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:48.510887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:48.511260 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:48.511401 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:48.512416 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0811 01:40:48.512667 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17573,"thread_start_us":17403,"threads_started":1}
I20260811 01:40:48.515748 31782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:48.473139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.1:55065)
0811 01:40:48.487580 (+ 14441us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:48.487651 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:48.491492 (+ 3841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:48.492923 (+ 1431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:48.492939 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:48.493828 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:48.494813 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:48.494855 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:48.496551 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:48.496557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:48.498718 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:48.498746 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:48.500172 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:48.500179 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:48.500508 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:48.501755 (+ 1247us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:48.501825 (+ 70us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:48.504738 (+ 2913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:48.509203 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:48.509214 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:48.509235 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:48.509929 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:48.510441 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:48.510446 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:48.510450 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:48.510739 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:48.511477 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:48.511487 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:48.511953 (+ 466us) client_negotiation.cc:769] Sending connection context
0811 01:40:48.513672 (+ 1719us) client_negotiation.cc:240] Negotiation successful
0811 01:40:48.514312 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14025,"thread_start_us":16914,"threads_started":1}
I20260811 01:40:48.518110 31779 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:48.518482 31779 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:48.519398 31779 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:48.522248 31546 ts_manager.cc:194] Registered new tserver with Master: 408018b9da51414fa9e263faadd1ae00 (127.17.132.1:42277)
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
I20260811 01:40:48.524326 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:55065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:40:48.571455 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:40:48 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412447, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
W20260811 01:40:49.147567 31786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:49.148309 31786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:49.148556 31786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:49.162899 31786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:49.163203 31786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:49.163463 31786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:40:49.181604 31786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:49.183864 31786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:49.186081 31786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:49.206326 31800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:49.210410 31801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:49.216317 31786 server_base.cc:1034] running on GCE node
W20260811 01:40:49.216642 31804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:49.217685 31786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:49.219587 31786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:49.220968 31786 hybrid_clock.cc:648] HybridClock initialized: now 1786412449220893 us; error 73 us; skew 500 ppm
I20260811 01:40:49.221524 31786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:49 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:49.227098 31786 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:40:49.230158 31786 webserver.cc:460] Webserver started at http://127.17.132.2:36461/ using document root <none> and password file <none>
I20260811 01:40:49.231571 31786 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:49.231807 31786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:49.232357 31786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:40:49 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:49.258927 31786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "c4cb3aaef9af426fa29df4494f6cad4d"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "9805a8103177f83c4c53a1eb295dc1bc"
server_key_iv: "c766d2498a37dc803b091ef0e29ef2ec"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.260484 31786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "c4cb3aaef9af426fa29df4494f6cad4d"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "9805a8103177f83c4c53a1eb295dc1bc"
server_key_iv: "c766d2498a37dc803b091ef0e29ef2ec"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.270416 31786 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.008s sys 0.000s
I20260811 01:40:49.295507 31811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:49.297719 31786 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260811 01:40:49.298070 31786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "c4cb3aaef9af426fa29df4494f6cad4d"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "9805a8103177f83c4c53a1eb295dc1bc"
server_key_iv: "c766d2498a37dc803b091ef0e29ef2ec"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.298398 31786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:49.341621 31786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:49.348539 31786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:49.348970 31786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:49.350484 31786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:49.352654 31786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:49.352768 31786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:49.352895 31786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:49.352962 31786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:49.411612 31786 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:41679
I20260811 01:40:49.411654 31938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:41679 every 8 connection(s)
I20260811 01:40:49.413650 31786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:40:49.423475 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 31786
I20260811 01:40:49.423664 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:40:49.424290 17936 external_mini_cluster.cc:1428] Setting key b22f823a1b5dd21666798bc10377eb96
Aug 11 01:40:49 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
I20260811 01:40:49.469527 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:49.418298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:33075 (local address 127.17.132.62:34761)
0811 01:40:49.444041 (+ 25743us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:49.444049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:49.444083 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:40:49.447429 (+ 3346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:49.447437 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:49.447558 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:49.447695 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:49.450439 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:49.451626 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:49.454607 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:49.455327 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:49.455460 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:49.460789 (+ 5329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:49.460797 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:49.460803 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:49.460856 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:49.464745 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:49.466053 (+ 1308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:49.466061 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:49.466065 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:49.466242 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:49.466881 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:49.466887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:49.466891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:49.467294 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:49.467462 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:49.468680 (+ 1218us) server_negotiation.cc:299] Negotiation successful
0811 01:40:49.469039 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25564,"thread_start_us":25765,"threads_started":1}
I20260811 01:40:49.471630 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:49.419991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.2:33075)
0811 01:40:49.441776 (+ 21785us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:49.441893 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:49.446743 (+ 4850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:49.448296 (+ 1553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:49.448312 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:49.449061 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:49.450118 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:49.450163 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:49.451927 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:49.451932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:49.454335 (+ 2403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:49.454361 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:49.455912 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:49.455921 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:49.456287 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:49.457216 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:49.457258 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:49.460416 (+ 3158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:49.465029 (+ 4613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:49.465039 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:49.465059 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:49.465764 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:49.466415 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:49.466421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:49.466424 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:49.466732 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:49.467570 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:49.467578 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:49.468125 (+ 547us) client_negotiation.cc:769] Sending connection context
0811 01:40:49.469345 (+ 1220us) client_negotiation.cc:240] Negotiation successful
0811 01:40:49.470058 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21313,"thread_start_us":22085,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
I20260811 01:40:49.474174 31939 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:49.474579 31939 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:49.475603 31939 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:49.477867 31546 ts_manager.cc:194] Registered new tserver with Master: c4cb3aaef9af426fa29df4494f6cad4d (127.17.132.2:41679)
I20260811 01:40:49.479276 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:33075
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:40:49.513649 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:40:49.528403 31779 heartbeater.cc:503] Master 127.17.132.62:34761 was elected leader, sending a full tablet report...
W20260811 01:40:49.906765 31945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:49.907142 31945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:49.907321 31945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:49.915241 31945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:49.915416 31945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:49.915602 31945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:40:49.926404 31945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:49.927942 31945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:49.929363 31945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:49.943890 31950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:49.944340 31953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:49.943851 31951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:49.944453 31945 server_base.cc:1034] running on GCE node
I20260811 01:40:49.945242 31945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:49.946297 31945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:49.947542 31945 hybrid_clock.cc:648] HybridClock initialized: now 1786412449947464 us; error 58 us; skew 500 ppm
I20260811 01:40:49.948123 31945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:49 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:49.951655 31945 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:40:49.953281 31945 webserver.cc:460] Webserver started at http://127.17.132.3:43877/ using document root <none> and password file <none>
I20260811 01:40:49.954118 31945 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:49.954272 31945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:49.954659 31945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:40:49 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:49.971426 31945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "89f85070259148e4a2659d48282664db"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "029a917b5cbe73d49c2d355e3c575f03"
server_key_iv: "27124e1d545ccb57e959a418818290e2"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.972553 31945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "89f85070259148e4a2659d48282664db"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "029a917b5cbe73d49c2d355e3c575f03"
server_key_iv: "27124e1d545ccb57e959a418818290e2"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.978497 31945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:40:49.994678 31960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:49.996228 31945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:40:49.996397 31945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "89f85070259148e4a2659d48282664db"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "029a917b5cbe73d49c2d355e3c575f03"
server_key_iv: "27124e1d545ccb57e959a418818290e2"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:49.996618 31945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:50.024746 31945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:50.029531 31945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:50.029897 31945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:50.030964 31945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:50.032660 31945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:50.032737 31945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:50.032838 31945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:50.032887 31945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:50.069147 31945 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:33181
I20260811 01:40:50.069188 32087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:33181 every 8 connection(s)
I20260811 01:40:50.070681 31945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:40:50.075457 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 31945
I20260811 01:40:50.075687 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:40:50.076318 17936 external_mini_cluster.cc:1428] Setting key 28b0bb51769459feb6071f74167d7529
Aug 11 01:40:50 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:50.093364 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:50.073585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:47713 (local address 127.17.132.62:34761)
0811 01:40:50.074163 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:50.074168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:50.075140 (+ 972us) server_negotiation.cc:407] Connection header received
0811 01:40:50.077728 (+ 2588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:50.077735 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:50.077873 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:50.078002 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:50.079846 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.080580 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.082254 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.082729 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.082868 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:50.086463 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:50.086475 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:50.086479 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:50.086514 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:50.089413 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.090388 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.090394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.090398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.090616 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.091188 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.091197 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.091199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.091634 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:50.091832 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:50.092911 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0811 01:40:50.093111 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":307,"threads_started":1}
I20260811 01:40:50.094605 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:50.074116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.3:47713)
0811 01:40:50.074897 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:50.074992 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:50.077423 (+ 2431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:50.078291 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:50.078300 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:50.078810 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:50.079638 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:50.079665 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.080754 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.080758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:50.082102 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:50.082115 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.082969 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.082979 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:50.083236 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:50.083901 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:50.083931 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:50.086210 (+ 2279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:50.089602 (+ 3392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:50.089614 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:50.089640 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:50.090235 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:50.090741 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:50.090746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:50.090750 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:50.091014 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:50.091931 (+ 917us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:50.091938 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:50.092478 (+ 540us) client_negotiation.cc:769] Sending connection context
0811 01:40:50.092810 (+ 332us) client_negotiation.cc:240] Negotiation successful
0811 01:40:50.093257 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":304,"threads_started":1}
I20260811 01:40:50.096115 32088 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:50.096490 32088 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:50.097314 32088 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:50.098975 31546 ts_manager.cc:194] Registered new tserver with Master: 89f85070259148e4a2659d48282664db (127.17.132.3:33181)
I20260811 01:40:50.099877 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:47713
I20260811 01:40:50.105329 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:40:50.107188 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 31634
Aug 11 01:40:50 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:40:50.124718 32093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:50.108208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44182 (local address 127.17.132.1:42277)
0811 01:40:50.108837 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:50.108844 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:50.108869 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:40:50.108929 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:50.108935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:50.109140 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:50.109280 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:50.110897 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.111936 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.113442 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.114097 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.114200 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:50.118605 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:50.118617 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:50.118633 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:50.118675 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:50.121758 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.122584 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.122592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.122595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.122770 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.123186 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.123189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.123191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.123583 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:50.123852 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:50.124197 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:40:50.124435 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":348,"threads_started":1}
I20260811 01:40:50.126135 31774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:50.215437 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 31634
I20260811 01:40:50.236517 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 31786
Aug 11 01:40:50 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:40:50.254971 32095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:50.237604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36692 (local address 127.17.132.2:41679)
0811 01:40:50.238233 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:50.238242 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:50.238272 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:40:50.238339 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:50.238345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:50.238582 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:50.238794 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:50.240211 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.241255 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.242936 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.243557 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.243718 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:50.248554 (+ 4836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:50.248569 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:50.248587 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:50.248631 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:50.251793 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.252593 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.252601 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.252604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.252763 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.253205 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.253209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.253211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.253588 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:50.253974 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:50.254306 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 01:40:50.254596 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":358,"threads_started":1}
I20260811 01:40:50.256335 31934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:50.344689 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 31786
I20260811 01:40:50.364584 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 31945
Aug 11 01:40:50 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:40:50.382767 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:50.365870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40360 (local address 127.17.132.3:33181)
0811 01:40:50.366603 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:50.366610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:50.366640 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:40:50.366703 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:50.366709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:50.366946 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:50.367082 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:50.368454 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.369518 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.370906 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:50.371543 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:50.371649 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:50.376308 (+ 4659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:50.376326 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:50.376344 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:50.376396 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:50.379412 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.380367 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.380376 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.380379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.380524 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:50.380968 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:50.380971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:50.380973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:50.381347 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:50.381707 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:50.382102 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 01:40:50.382392 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":391,"threads_started":1}
I20260811 01:40:50.384227 32083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:50.470860 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 31945
I20260811 01:40:50.490526 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 31511
I20260811 01:40:50.491874 31580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:50.603756 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 31511
I20260811 01:40:50.631846 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34761
--webserver_interface=127.17.132.62
--webserver_port=34393
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34761
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:40:51.020942 32100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:51.021342 32100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:51.021519 32100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:51.029053 32100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:40:51.029244 32100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:51.029358 32100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:51.029470 32100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:40:51.029577 32100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:40:51.040346 32100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34761
--ranger_config_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=34393
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:51.041913 32100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:51.043340 32100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:51.055729 32106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:51.055799 32109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:51.055828 32105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:51.056849 32100 server_base.cc:1034] running on GCE node
I20260811 01:40:51.057658 32100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:51.059190 32100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:51.060400 32100 hybrid_clock.cc:648] HybridClock initialized: now 1786412451060363 us; error 31 us; skew 500 ppm
I20260811 01:40:51.060793 32100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:51 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412451, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:51.064116 32100 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:40:51.065685 32100 webserver.cc:460] Webserver started at http://127.17.132.62:34393/ using document root <none> and password file <none>
I20260811 01:40:51.066434 32100 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:51.066552 32100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:40:51 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412451, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:51.153247 32100 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:40:51.156737 32117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:51.158331 32100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:40:51.158541 32100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "956ebfc532b84d528a64015767074135"
format_stamp: "Formatted at 2026-08-11 01:40:46 on dist-test-slave-0kls"
server_key: "e22b94b546a7bf29af500d39c6aae9ff"
server_key_iv: "7ae298f103933b387cc7af7752c757d9"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:51.159610 32100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:51.177496 32100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:51.181608 32100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:51.181999 32100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:51.203146 32100 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34761
I20260811 01:40:51.203197 32177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34761 every 8 connection(s)
I20260811 01:40:51.204798 32100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:40:51.206681 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 32100
I20260811 01:40:51.207612 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:42277
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:34761
--webserver_port=40317
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:40:51.212409 32178 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:40:51.215946 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Bootstrap starting.
I20260811 01:40:51.237231 32178 log.cc:824] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:51.248092 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:40:51.248754 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Bootstrap complete.
I20260811 01:40:51.259238 32178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:51.260201 32178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 956ebfc532b84d528a64015767074135, State: Initialized, Role: FOLLOWER
I20260811 01:40:51.260857 32178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:51.261104 32178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:40:51.261240 32178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:40:51.261432 32178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:40:51.265923 32178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:51.266461 32178 leader_election.cc:302] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 956ebfc532b84d528a64015767074135; no voters:
I20260811 01:40:51.267155 32178 leader_election.cc:288] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:40:51.267307 32182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:40:51.269774 32178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:40:51.269565 32182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [term 2 LEADER]: Becoming Leader. State: Replica: 956ebfc532b84d528a64015767074135, State: Running, Role: LEADER
I20260811 01:40:51.270579 32182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } }
I20260811 01:40:51.273478 32184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 956ebfc532b84d528a64015767074135. Latest consensus state: current_term: 2 leader_uuid: "956ebfc532b84d528a64015767074135" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } } }
I20260811 01:40:51.273985 32184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:51.274636 32183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "956ebfc532b84d528a64015767074135" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956ebfc532b84d528a64015767074135" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34761 } } }
I20260811 01:40:51.274971 32183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:51.281731 32190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:40:51.289099 32190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:40:51.290951 32190 catalog_manager.cc:1259] Loaded cluster ID: 679c4a27a28a4b9eba5071faf86929ab
I20260811 01:40:51.291172 32190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:40:51.295802 32190 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:40:51.297554 32190 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Loaded TSK: 0
I20260811 01:40:51.299280 32190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:40:51.302451 32178 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 01:40:51.663384 32180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:51.663805 32180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:51.664021 32180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:51.675184 32180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:51.675418 32180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:51.675665 32180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:40:51.691231 32180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:42277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=40317
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:51.692718 32180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:51.694214 32180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:51.727917 32220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:51.732129 32219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:51.732157 32223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:51.734212 32180 server_base.cc:1034] running on GCE node
I20260811 01:40:51.735113 32180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:51.736868 32180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:51.740259 32180 hybrid_clock.cc:648] HybridClock initialized: now 1786412451740173 us; error 63 us; skew 500 ppm
I20260811 01:40:51.740814 32180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:51 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412451, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:51.752051 32180 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:40:51.758276 32180 webserver.cc:460] Webserver started at http://127.17.132.1:40317/ using document root <none> and password file <none>
I20260811 01:40:51.759644 32180 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:51.759994 32180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:40:51 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412451, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:51.800065 32180 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.005s sys 0.001s
I20260811 01:40:51.810762 32231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:51.813398 32180 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.007s
I20260811 01:40:51.813824 32180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "408018b9da51414fa9e263faadd1ae00"
format_stamp: "Formatted at 2026-08-11 01:40:48 on dist-test-slave-0kls"
server_key: "a63230cf6983da25d9f8b8982758a757"
server_key_iv: "aa4b626404557f87bde768765becf4c3"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:51.815758 32180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:51.907819 32180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:51.913636 32180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:51.914088 32180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:51.915560 32180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:51.917522 32180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:51.917675 32180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:51.917858 32180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:51.917963 32180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:51.982100 32180 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42277
I20260811 01:40:51.982122 32357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42277 every 8 connection(s)
I20260811 01:40:51.984330 32180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:40:51.990384 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 32180
I20260811 01:40:51.991431 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:41679
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:34761
--webserver_port=36461
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:40:52 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412451, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:52.036839 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:51.988287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.1:36259)
0811 01:40:51.994603 (+ 6316us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:51.994676 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:51.997682 (+ 3006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:52.000362 (+ 2680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:52.000375 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:52.001357 (+ 982us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:52.002474 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:52.002526 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.006193 (+ 3667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.006201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:52.009133 (+ 2932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:52.009183 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.012017 (+ 2834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.012027 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:52.012429 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:52.018245 (+ 5816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:52.018297 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:52.022581 (+ 4284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:52.029379 (+ 6798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:52.029397 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:52.029424 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:52.030448 (+ 1024us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:52.031318 (+ 870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:52.031327 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:52.031335 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:52.031692 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:52.033139 (+ 1447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:52.033151 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:52.033747 (+ 596us) client_negotiation.cc:769] Sending connection context
0811 01:40:52.034210 (+ 463us) client_negotiation.cc:240] Negotiation successful
0811 01:40:52.035046 (+ 836us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5929,"thread_start_us":5634,"threads_started":1}
I20260811 01:40:52.036846 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:51.988280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:36259 (local address 127.17.132.62:34761)
0811 01:40:51.989207 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:51.989228 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:51.994888 (+ 5660us) server_negotiation.cc:407] Connection header received
0811 01:40:51.998809 (+ 3921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:51.998839 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:51.999487 (+ 648us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:52.000041 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:52.002913 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.005729 (+ 2816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.009473 (+ 3744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.011043 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.011341 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:52.023469 (+ 12128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:52.023487 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:52.023519 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:52.023596 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:52.029042 (+ 5446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:52.030727 (+ 1685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:52.030753 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:52.030765 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:52.031100 (+ 335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:52.031909 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:52.031915 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:52.031919 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:52.032897 (+ 978us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:52.033161 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:52.034584 (+ 1423us) server_negotiation.cc:299] Negotiation successful
0811 01:40:52.035183 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":346,"threads_started":1}
I20260811 01:40:52.043608 32359 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:52.043998 32359 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:52.045023 32359 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
W20260811 01:40:52.049492 32359 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34761 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:40:52.049829 32359 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:52.050158 32359 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:52.051887 32359 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:52.052312 32359 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
W20260811 01:40:52.053701 32359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:40:52.433694 32363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:52.434125 32363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:52.434315 32363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:52.442847 32363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:52.443008 32363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:52.443188 32363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:40:52.453694 32363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:41679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=36461
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:52.455295 32363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:52.456707 32363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:52.476617 32377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:52.476574 32380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:52.477550 32376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:52.478253 32363 server_base.cc:1034] running on GCE node
I20260811 01:40:52.479018 32363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:52.480185 32363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:52.481447 32363 hybrid_clock.cc:648] HybridClock initialized: now 1786412452481384 us; error 55 us; skew 500 ppm
I20260811 01:40:52.481873 32363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:52 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:52.486456 32363 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:40:52.491614 32363 webserver.cc:460] Webserver started at http://127.17.132.2:36461/ using document root <none> and password file <none>
I20260811 01:40:52.492710 32363 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:52.492903 32363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:40:52 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:52.520102 32363 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 01:40:52.524174 32389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:52.526152 32363 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:40:52.526384 32363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "c4cb3aaef9af426fa29df4494f6cad4d"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "9805a8103177f83c4c53a1eb295dc1bc"
server_key_iv: "c766d2498a37dc803b091ef0e29ef2ec"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:52.527942 32363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:52.552568 32363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:52.558091 32363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:52.558418 32363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:52.565827 32363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:52.571370 32363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:52.571532 32363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:52.571659 32363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:52.571751 32363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:52.648600 32363 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:41679
I20260811 01:40:52.648787 32519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:41679 every 8 connection(s)
I20260811 01:40:52.650532 32363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:40:52.654844 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 32363
I20260811 01:40:52.655815 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.132.20:51121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:33181
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:34761
--webserver_port=43877
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:40:52 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:52.686435 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:52.655007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:41405 (local address 127.17.132.62:34761)
0811 01:40:52.656118 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:52.656125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:52.660041 (+ 3916us) server_negotiation.cc:407] Connection header received
0811 01:40:52.660130 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:52.660135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:52.660224 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:52.660330 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:52.664727 (+ 4397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.665928 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.668379 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.669035 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.669159 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:52.678284 (+ 9125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:52.678293 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:52.678299 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:52.678346 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:52.682057 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:52.683242 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:52.683248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:52.683251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:52.683413 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:52.684060 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:52.684066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:52.684070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:52.684483 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:52.684648 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:52.685737 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0811 01:40:52.686037 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":956,"thread_start_us":828,"threads_started":1}
Aug 11 01:40:52 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:52.689194 32522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:52.654292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.2:41405)
0811 01:40:52.657129 (+ 2837us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:52.657181 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:52.659626 (+ 2445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:52.663008 (+ 3382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:52.663021 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:52.663654 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:52.664501 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:52.664528 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.666152 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.666158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:52.668188 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:52.668215 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:52.669544 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:52.669552 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:52.669870 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:52.674857 (+ 4987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:52.674893 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:52.677922 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:52.682277 (+ 4355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:52.682289 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:52.682312 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:52.683069 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:52.683578 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:52.683583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:52.683586 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:52.683914 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:52.684748 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:52.684758 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:52.685256 (+ 498us) client_negotiation.cc:769] Sending connection context
0811 01:40:52.687004 (+ 1748us) client_negotiation.cc:240] Negotiation successful
0811 01:40:52.687710 (+ 706us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2503,"thread_start_us":2238,"threads_started":1}
I20260811 01:40:52.691306 32520 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:52.691649 32520 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:52.692628 32520 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:52.695005 32138 ts_manager.cc:194] Registered new tserver with Master: c4cb3aaef9af426fa29df4494f6cad4d (127.17.132.2:41679)
I20260811 01:40:52.697291 32138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:41405
I20260811 01:40:53.053920 32359 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:53.054410 32359 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:53.055729 32138 ts_manager.cc:194] Registered new tserver with Master: 408018b9da51414fa9e263faadd1ae00 (127.17.132.1:42277)
I20260811 01:40:53.056984 32138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:36259
W20260811 01:40:53.107985 32524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:53.108428 32524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:53.108645 32524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:53.120776 32524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:53.120962 32524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:53.121163 32524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:40:53.137392 32524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.132.20:51121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:33181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=43877
--tserver_master_addrs=127.17.132.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:53.139369 32524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:53.141258 32524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:53.161301 32530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:53.161363 32531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:53.169463 32524 server_base.cc:1034] running on GCE node
W20260811 01:40:53.169759 32534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:53.172762 32524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:53.174090 32524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:53.175336 32524 hybrid_clock.cc:648] HybridClock initialized: now 1786412453175271 us; error 49 us; skew 500 ppm
I20260811 01:40:53.175719 32524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:53 dist-test-slave-0kls krb5kdc[31013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412453, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 01:40:53 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:53.180590 32524 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:40:53.183411 32524 webserver.cc:460] Webserver started at http://127.17.132.3:43877/ using document root <none> and password file <none>
I20260811 01:40:53.184445 32524 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:53.184618 32524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:40:53 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412453, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:53.224761 32524 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.011s sys 0.007s
I20260811 01:40:53.250600 32541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:53.252898 32524 fs_manager.cc:725] Time spent opening block manager: real 0.026s user 0.005s sys 0.019s
I20260811 01:40:53.253129 32524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "89f85070259148e4a2659d48282664db"
format_stamp: "Formatted at 2026-08-11 01:40:49 on dist-test-slave-0kls"
server_key: "029a917b5cbe73d49c2d355e3c575f03"
server_key_iv: "27124e1d545ccb57e959a418818290e2"
server_key_version: "kuduclusterkey@0"
I20260811 01:40:53.254547 32524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:53.316618 32524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:53.322557 32524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:53.322907 32524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:53.334182 32524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:40:53.341625 32524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:40:53.341771 32524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:53.341931 32524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:40:53.342007 32524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:40:53 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412452, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for HTTP/127.17.132.20@KRBTEST.COM
I20260811 01:40:53.631091 32524 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:33181
I20260811 01:40:53.631146 32666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:33181 every 8 connection(s)
I20260811 01:40:53.632856 32524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:40:53.638545 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 32524
I20260811 01:40:53.685583 32674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.658518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47708 (local address 127.17.132.62:34761)
0811 01:40:53.661230 (+ 2712us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.661236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.661257 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:40:53.661323 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.661328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.661431 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.661554 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:53.663810 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.665092 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.667416 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.668085 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.668207 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.676224 (+ 8017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:53.676232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:53.676237 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:53.676285 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:53.680310 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.682402 (+ 2092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.682407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.682411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.682575 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.683062 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.683067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.683071 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.683439 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:53.683702 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.684927 (+ 1225us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.685162 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2524,"thread_start_us":7033,"threads_started":1}
Aug 11 01:40:53 dist-test-slave-0kls krb5kdc[31013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412453, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:53.699397 32670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.636536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:39345 (local address 127.17.132.62:34761)
0811 01:40:53.658624 (+ 22088us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.658634 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.671506 (+ 12872us) server_negotiation.cc:407] Connection header received
0811 01:40:53.676914 (+ 5408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.676920 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.677040 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.677129 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:53.679677 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.681018 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.684392 (+ 3374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.685048 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.685144 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.692374 (+ 7230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:53.692381 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:53.692385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:53.692426 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:53.695803 (+ 3377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.696582 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.696588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.696591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.696719 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.697225 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.697232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.697235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.697630 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:53.697826 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.698771 (+ 945us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.699015 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21900,"thread_start_us":21716,"threads_started":1}
I20260811 01:40:53.701720 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.636995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34761 (local address 127.17.132.3:39345)
0811 01:40:53.671310 (+ 34315us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:53.671366 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:53.673968 (+ 2602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:53.677861 (+ 3893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:53.677874 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:53.678558 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:53.679406 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.679434 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.682049 (+ 2615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.682055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.684215 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.684242 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.685527 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.685534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.685880 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.689239 (+ 3359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:53.689281 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:53.692063 (+ 2782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:53.695987 (+ 3924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:53.695995 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:53.696008 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:53.696436 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:53.696836 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:53.696841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:53.696844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:53.697090 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:53.697778 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:53.697829 (+ 51us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:53.698301 (+ 472us) client_negotiation.cc:769] Sending connection context
0811 01:40:53.699633 (+ 1332us) client_negotiation.cc:240] Negotiation successful
0811 01:40:53.700261 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32588,"thread_start_us":32339,"threads_started":1}
I20260811 01:40:53.702385 32520 heartbeater.cc:503] Master 127.17.132.62:34761 was elected leader, sending a full tablet report...
I20260811 01:40:53.703863 32668 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34761
I20260811 01:40:53.704208 32668 heartbeater.cc:464] Registering TS with master...
I20260811 01:40:53.705138 32668 heartbeater.cc:511] Master 127.17.132.62:34761 requested a full tablet report, sending...
I20260811 01:40:53.706831 32138 ts_manager.cc:194] Registered new tserver with Master: 89f85070259148e4a2659d48282664db (127.17.132.3:33181)
I20260811 01:40:53.707986 32138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:39345
I20260811 01:40:53.714093 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:40:53.756541 32670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.732440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47714 (local address 127.17.132.62:34761)
0811 01:40:53.732641 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.732649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.738495 (+ 5846us) server_negotiation.cc:407] Connection header received
0811 01:40:53.738712 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.738719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.738832 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.738961 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:53.741130 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.742303 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.744346 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.744966 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.745071 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.749050 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:53.749057 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:53.749063 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:53.749110 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:53.752948 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.753954 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.753960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.753964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.754143 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:53.754652 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:53.754657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:53.754661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:53.755042 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:53.755278 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.755908 (+ 630us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.756174 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:40:53.764670 32138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:40:53.776808 32138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:40:53.829151 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.797291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:33181 (local address 127.0.0.1:58386)
0811 01:40:53.806328 (+ 9037us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:53.806348 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:53.806468 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:53.819550 (+ 13082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:53.819561 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:53.819625 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:40:53.820136 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.820152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.822421 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.822430 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.825480 (+ 3050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.825503 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.828092 (+ 2589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.828099 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.828333 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.828391 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 01:40:53.828533 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 01:40:53.828742 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8897,"threads_started":1}
I20260811 01:40:53.830641 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.798033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58386 (local address 127.17.132.3:33181)
0811 01:40:53.818620 (+ 20587us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.818634 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.818689 (+ 55us) server_negotiation.cc:407] Connection header received
0811 01:40:53.818837 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.818850 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.819217 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.819513 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:40:53.820376 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.822236 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.825778 (+ 3542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.827438 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.827593 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.827900 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.830010 (+ 2110us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.830238 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20342,"thread_start_us":20181,"threads_started":1}
I20260811 01:40:53.835089 32594 tablet_service.cc:1467] Processing CreateTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd (DEFAULT_TABLE table=test-table [id=ae333bfa38cd4b70ac64c6f4c72edfde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:40:53.836902 32594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 149aa6c0c5ef4fc8a971d063479464fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:53.840255 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.796798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:41679 (local address 127.0.0.1:52500)
0811 01:40:53.798466 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:53.798513 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:53.798751 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:53.830385 (+ 31634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:53.830391 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:53.830420 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:40:53.830840 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.830856 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.834647 (+ 3791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.834654 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.837015 (+ 2361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.837032 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.838996 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.839001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.839329 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.839470 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 01:40:53.839557 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 01:40:53.839817 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1333,"mutex_wait_us":279,"thread_start_us":1160,"threads_started":1}
I20260811 01:40:53.841194 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.799662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36080 (local address 127.17.132.1:42277)
0811 01:40:53.828462 (+ 28800us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.828473 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.831989 (+ 3516us) server_negotiation.cc:407] Connection header received
0811 01:40:53.832101 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.832110 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.832380 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.832953 (+ 573us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:40:53.833228 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.834715 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.837212 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.838741 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.840309 (+ 1568us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.840565 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.840648 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.840820 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28605,"thread_start_us":28812,"threads_started":1}
I20260811 01:40:53.840255 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.798940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36080)
0811 01:40:53.829664 (+ 30724us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:53.829685 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:53.829817 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:53.832594 (+ 2777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:53.832599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:53.832625 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:40:53.832776 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.832785 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.834895 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.834901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.837037 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:53.837046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.838961 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.838969 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:53.839328 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.839470 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 01:40:53.839557 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 01:40:53.839817 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30604,"mutex_wait_us":256,"thread_start_us":7101,"threads_started":1}
I20260811 01:40:53.843199 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:53.797396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52500 (local address 127.17.132.2:41679)
0811 01:40:53.829174 (+ 31778us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:53.829185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:53.829220 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:40:53.829347 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:53.829355 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:53.829655 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:53.831097 (+ 1442us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:40:53.831356 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.834478 (+ 3122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.837285 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:53.838741 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:53.840832 (+ 2091us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:53.841075 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:53.841147 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 01:40:53.841363 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31593,"thread_start_us":36895,"threads_started":1}
I20260811 01:40:53.846261 32282 tablet_service.cc:1467] Processing CreateTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd (DEFAULT_TABLE table=test-table [id=ae333bfa38cd4b70ac64c6f4c72edfde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:40:53.846866 32444 tablet_service.cc:1467] Processing CreateTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd (DEFAULT_TABLE table=test-table [id=ae333bfa38cd4b70ac64c6f4c72edfde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:40:53.847999 32282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 149aa6c0c5ef4fc8a971d063479464fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:53.848317 32444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 149aa6c0c5ef4fc8a971d063479464fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:53.865368 32693 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Bootstrap starting.
I20260811 01:40:53.869963 32694 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Bootstrap starting.
I20260811 01:40:53.871285 32693 tablet_bootstrap.cc:654] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:53.872262 32695 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Bootstrap starting.
I20260811 01:40:53.872824 32693 log.cc:824] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:53.881114 32694 tablet_bootstrap.cc:654] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:53.882922 32693 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: No bootstrap required, opened a new log
I20260811 01:40:53.883386 32693 ts_tablet_manager.cc:1397] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.002s
I20260811 01:40:53.883697 32694 log.cc:824] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:53.885179 32695 tablet_bootstrap.cc:654] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:53.886638 32695 log.cc:824] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:53.896799 32695 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: No bootstrap required, opened a new log
I20260811 01:40:53.896661 32693 raft_consensus.cc:348] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.897200 32695 ts_tablet_manager.cc:1397] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.007s
I20260811 01:40:53.898059 32693 raft_consensus.cc:374] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:53.898276 32693 raft_consensus.cc:729] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89f85070259148e4a2659d48282664db, State: Initialized, Role: FOLLOWER
I20260811 01:40:53.899204 32693 consensus_queue.cc:260] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.903271 32694 tablet_bootstrap.cc:492] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: No bootstrap required, opened a new log
I20260811 01:40:53.903651 32694 ts_tablet_manager.cc:1397] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Time spent bootstrapping tablet: real 0.034s user 0.014s sys 0.008s
I20260811 01:40:53.907967 32668 heartbeater.cc:503] Master 127.17.132.62:34761 was elected leader, sending a full tablet report...
I20260811 01:40:53.909109 32693 ts_tablet_manager.cc:1428] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Time spent starting tablet: real 0.026s user 0.013s sys 0.008s
I20260811 01:40:53.912094 32695 raft_consensus.cc:348] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.913113 32695 raft_consensus.cc:374] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:53.913273 32695 raft_consensus.cc:729] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4cb3aaef9af426fa29df4494f6cad4d, State: Initialized, Role: FOLLOWER
I20260811 01:40:53.914182 32695 consensus_queue.cc:260] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.914631 32694 raft_consensus.cc:348] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.915406 32694 raft_consensus.cc:374] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:53.915580 32694 raft_consensus.cc:729] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 408018b9da51414fa9e263faadd1ae00, State: Initialized, Role: FOLLOWER
I20260811 01:40:53.916415 32694 consensus_queue.cc:260] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:53.918220 32695 ts_tablet_manager.cc:1428] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Time spent starting tablet: real 0.021s user 0.014s sys 0.003s
I20260811 01:40:53.919348 32359 heartbeater.cc:503] Master 127.17.132.62:34761 was elected leader, sending a full tablet report...
I20260811 01:40:53.920101 32694 ts_tablet_manager.cc:1428] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
W20260811 01:40:53.987782 32360 tablet.cc:2369] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:40:54.018637 32705 raft_consensus.cc:482] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:40:54.018956 32705 raft_consensus.cc:504] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:54.020768 32705 leader_election.cc:288] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 408018b9da51414fa9e263faadd1ae00 (127.17.132.1:42277), 89f85070259148e4a2659d48282664db (127.17.132.3:33181)
I20260811 01:40:54.029081 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.021739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:39461 (local address 127.17.132.1:42277)
0811 01:40:54.021981 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.021987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.022761 (+ 774us) server_negotiation.cc:407] Connection header received
0811 01:40:54.023021 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.023026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.023101 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.023161 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:40:54.023982 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.025018 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.026900 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.028040 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.028221 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.028315 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.028674 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.028818 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 01:40:54.029354 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.021405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:34763 (local address 127.17.132.3:33181)
0811 01:40:54.021670 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.021679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.022482 (+ 803us) server_negotiation.cc:407] Connection header received
0811 01:40:54.022799 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.022803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.022867 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.022971 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:40:54.023555 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.024679 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.027241 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.028445 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.028644 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.028714 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.029005 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.029133 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:40:54.029693 32710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.021062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:33181 (local address 127.17.132.2:34763)
0811 01:40:54.022343 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.022369 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:54.022616 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:54.022989 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:54.022994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:54.023020 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:40:54.023404 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:54.023416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.024814 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.024819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:54.027073 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:54.027088 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.028661 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.028668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:54.028845 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.028868 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:40:54.028974 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:40:54.029113 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":1303,"threads_started":1}
I20260811 01:40:54.030094 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.021199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.17.132.2:39461)
0811 01:40:54.022658 (+ 1459us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.022676 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:54.022866 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:54.023358 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:54.023363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:54.023391 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:40:54.023778 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:54.023790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.025147 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.025152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:54.026748 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:54.026761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.028276 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.028283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:54.028450 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.028486 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:40:54.029394 (+ 908us) client_negotiation.cc:240] Negotiation successful
0811 01:40:54.029526 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1328,"thread_start_us":781,"threads_started":1}
I20260811 01:40:54.030848 32614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "149aa6c0c5ef4fc8a971d063479464fd" candidate_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89f85070259148e4a2659d48282664db" is_pre_election: true
I20260811 01:40:54.030999 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "149aa6c0c5ef4fc8a971d063479464fd" candidate_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "408018b9da51414fa9e263faadd1ae00" is_pre_election: true
I20260811 01:40:54.031450 32614 raft_consensus.cc:2454] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4cb3aaef9af426fa29df4494f6cad4d in term 0.
I20260811 01:40:54.031558 32305 raft_consensus.cc:2454] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4cb3aaef9af426fa29df4494f6cad4d in term 0.
I20260811 01:40:54.032217 32392 leader_election.cc:302] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 408018b9da51414fa9e263faadd1ae00, 89f85070259148e4a2659d48282664db, c4cb3aaef9af426fa29df4494f6cad4d; no voters:
I20260811 01:40:54.032648 32705 raft_consensus.cc:2781] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:40:54.032805 32705 raft_consensus.cc:482] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:40:54.032914 32705 raft_consensus.cc:3037] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:54.035535 32705 raft_consensus.cc:504] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:54.036136 32705 leader_election.cc:288] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [CANDIDATE]: Term 1 election: Requested vote from peers 408018b9da51414fa9e263faadd1ae00 (127.17.132.1:42277), 89f85070259148e4a2659d48282664db (127.17.132.3:33181)
I20260811 01:40:54.036630 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "149aa6c0c5ef4fc8a971d063479464fd" candidate_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "408018b9da51414fa9e263faadd1ae00"
I20260811 01:40:54.036736 32614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "149aa6c0c5ef4fc8a971d063479464fd" candidate_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89f85070259148e4a2659d48282664db"
I20260811 01:40:54.036845 32305 raft_consensus.cc:3037] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:54.036958 32614 raft_consensus.cc:3037] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:54.039366 32305 raft_consensus.cc:2454] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4cb3aaef9af426fa29df4494f6cad4d in term 1.
I20260811 01:40:54.039868 32391 leader_election.cc:302] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 408018b9da51414fa9e263faadd1ae00, c4cb3aaef9af426fa29df4494f6cad4d; no voters:
I20260811 01:40:54.040253 32705 raft_consensus.cc:2781] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:40:54.040413 32614 raft_consensus.cc:2454] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4cb3aaef9af426fa29df4494f6cad4d in term 1.
I20260811 01:40:54.041039 32705 raft_consensus.cc:686] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 1 LEADER]: Becoming Leader. State: Replica: c4cb3aaef9af426fa29df4494f6cad4d, State: Running, Role: LEADER
I20260811 01:40:54.041558 32705 consensus_queue.cc:237] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } }
I20260811 01:40:54.046591 32137 catalog_manager.cc:5495] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d reported cstate change: term changed from 0 to 1, leader changed from <none> to c4cb3aaef9af426fa29df4494f6cad4d (127.17.132.2). New cstate: current_term: 1 leader_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4cb3aaef9af426fa29df4494f6cad4d" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 41679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 } health_report { overall_health: UNKNOWN } } }
I20260811 01:40:54.111999 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.105809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52516 (local address 127.17.132.2:41679)
0811 01:40:54.106020 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.106025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.106043 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:40:54.106268 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.106271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.106360 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.106491 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:40:54.106942 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.107693 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.109635 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.110128 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.110227 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.110816 (+ 589us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:40:54.111371 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:40:54.111492 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.111631 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.111701 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:40:54.122937 32305 raft_consensus.cc:1261] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 1 FOLLOWER]: Refusing update from remote peer c4cb3aaef9af426fa29df4494f6cad4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:40:54.122965 32614 raft_consensus.cc:1261] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 1 FOLLOWER]: Refusing update from remote peer c4cb3aaef9af426fa29df4494f6cad4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:40:54.124331 32712 consensus_queue.cc:1035] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89f85070259148e4a2659d48282664db" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:40:54.124850 32705 consensus_queue.cc:1035] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "408018b9da51414fa9e263faadd1ae00" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:40:54.135051 32669 tablet.cc:2369] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:40:54.139509 32715 mvcc.cc:205] Tried to move back new op lower bound from 7317145412074487808 to 7317145411758247936. Current Snapshot: MvccSnapshot[applied={T|T < 7317145412074487808}]
I20260811 01:40:54.160208 32717 mvcc.cc:205] Tried to move back new op lower bound from 7317145412074487808 to 7317145411758247936. Current Snapshot: MvccSnapshot[applied={T|T < 7317145412074487808}]
I20260811 01:40:54.175138 32137 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:40:54.175482 32137 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:40:54.179512 32137 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 956ebfc532b84d528a64015767074135: Sending DeleteTablet for 3 replicas of tablet 149aa6c0c5ef4fc8a971d063479464fd
I20260811 01:40:54.181279 32282 tablet_service.cc:1514] Processing DeleteTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:40:54 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:36080
I20260811 01:40:54.182510 32444 tablet_service.cc:1514] Processing DeleteTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:40:54 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:52500
I20260811 01:40:54.186553 32594 tablet_service.cc:1514] Processing DeleteTablet for tablet 149aa6c0c5ef4fc8a971d063479464fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:40:54 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:58386
I20260811 01:40:54.187534 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 32180
I20260811 01:40:54.199966 32726 tablet_replica.cc:330] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: stopping tablet replica
I20260811 01:40:54.200515 32727 tablet_replica.cc:330] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: stopping tablet replica
I20260811 01:40:54.200788 32726 raft_consensus.cc:2229] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:40:54.200977 32727 raft_consensus.cc:2229] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:40:54.201470 32726 raft_consensus.cc:2258] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:40:54.201777 32727 raft_consensus.cc:2258] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:40:54.204015 32726 ts_tablet_manager.cc:1905] T 149aa6c0c5ef4fc8a971d063479464fd P 408018b9da51414fa9e263faadd1ae00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:40:54.205662 32727 ts_tablet_manager.cc:1905] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:40:54.206327 32728 tablet_replica.cc:330] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: stopping tablet replica
I20260811 01:40:54.206787 32728 raft_consensus.cc:2229] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:40:54.207273 32728 raft_consensus.cc:2258] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:40:54.214322 32727 ts_tablet_manager.cc:1918] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:40:54.214552 32727 log.cc:1196] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/149aa6c0c5ef4fc8a971d063479464fd
I20260811 01:40:54.215163 32727 ts_tablet_manager.cc:1939] T 149aa6c0c5ef4fc8a971d063479464fd P c4cb3aaef9af426fa29df4494f6cad4d: Deleting consensus metadata
I20260811 01:40:54.217294 32119 catalog_manager.cc:4841] TS c4cb3aaef9af426fa29df4494f6cad4d (127.17.132.2:41679): tablet 149aa6c0c5ef4fc8a971d063479464fd (table test-table [id=ae333bfa38cd4b70ac64c6f4c72edfde]) successfully deleted
I20260811 01:40:54.219442 32728 ts_tablet_manager.cc:1905] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:40:54.233892 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.189433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36082 (local address 127.17.132.1:42277)
0811 01:40:54.189704 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.189712 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.199349 (+ 9637us) server_negotiation.cc:407] Connection header received
0811 01:40:54.202880 (+ 3531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.202886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.202999 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.203093 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:54.211853 (+ 8760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.218268 (+ 6415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.220408 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.221019 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.221172 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.225192 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:54.225213 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:54.225233 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:54.225282 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:54.229368 (+ 4086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.230395 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.230407 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.230411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.230588 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.231050 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.231055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.231059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.231582 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:54.231908 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.233205 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.233477 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:40:54.234652 32353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:54.238874 32728 ts_tablet_manager.cc:1918] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:40:54.239168 32728 log.cc:1196] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/149aa6c0c5ef4fc8a971d063479464fd
I20260811 01:40:54.239843 32728 ts_tablet_manager.cc:1939] T 149aa6c0c5ef4fc8a971d063479464fd P 89f85070259148e4a2659d48282664db: Deleting consensus metadata
I20260811 01:40:54.241945 32120 catalog_manager.cc:4841] TS 89f85070259148e4a2659d48282664db (127.17.132.3:33181): tablet 149aa6c0c5ef4fc8a971d063479464fd (table test-table [id=ae333bfa38cd4b70ac64c6f4c72edfde]) successfully deleted
I20260811 01:40:54.367787 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 32180
W20260811 01:40:54.397953 32119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:42277 (error 108)
I20260811 01:40:54.398732 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 32363
I20260811 01:40:54.400879 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.399461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36092)
0811 01:40:54.400491 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.400624 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":826,"threads_started":1}
W20260811 01:40:54.401214 32119 catalog_manager.cc:4584] TS 408018b9da51414fa9e263faadd1ae00 (127.17.132.1:42277): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 149aa6c0c5ef4fc8a971d063479464fd: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
I20260811 01:40:54.416672 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.399532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.17.132.2:41679)
0811 01:40:54.399731 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.399739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.399964 (+ 225us) server_negotiation.cc:407] Connection header received
0811 01:40:54.400204 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.400210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.400296 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.400412 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:54.402258 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.403570 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.404909 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.405642 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.405823 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.408979 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:54.409000 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:54.409021 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:54.409082 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:54.413377 (+ 4295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.414197 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.414209 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.414213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.414416 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.414811 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.414817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.414820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.415341 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:54.415727 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.415924 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.416205 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:40:54.417528 32513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:54.454953 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.454403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36096)
0811 01:40:54.454650 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.454776 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 01:40:54.456228 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.455791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36098)
0811 01:40:54.455970 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.456064 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 01:40:54.517169 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.516622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36100)
0811 01:40:54.516850 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.516988 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 01:40:54.518405 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.517979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36108)
0811 01:40:54.518141 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.518228 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 01:40:54.539553 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 32363
I20260811 01:40:54.563105 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 32524
I20260811 01:40:54.578522 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.563982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58392 (local address 127.17.132.3:33181)
0811 01:40:54.564525 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:54.564530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:54.564546 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:40:54.564608 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:54.564612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:54.564687 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:54.564812 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:54.566295 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.567017 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.568444 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:54.568870 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:54.569015 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:54.572073 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:54.572094 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:54.572112 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:54.572169 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:54.575356 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.576182 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.576191 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.576193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.576342 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:54.576782 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:54.576788 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:54.576793 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:54.577215 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:54.577537 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:54.577900 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 01:40:54.578151 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":281,"threads_started":1}
I20260811 01:40:54.579286 32662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:54.599304 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.598826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36112)
0811 01:40:54.599050 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.599141 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:40:54.600656 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.600187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36118)
0811 01:40:54.600419 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.600508 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 01:40:54.672659 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 32524
I20260811 01:40:54.693420 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 32100
I20260811 01:40:54.694962 32173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:40:54.810601 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 32100
I20260811 01:40:54.810632 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:54.810037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42277 (local address 127.0.0.1:36130)
0811 01:40:54.810315 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:54.810450 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 01:40:54.838375 17936 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:40:55.184734 17936 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:40:55.184947 17936 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:40:55.531173 17936 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:40:55.531 UTC [31047] LOG: received smart shutdown request
2026-08-11 01:40:55.534 UTC [31047] LOG: background worker "logical replication launcher" (PID 31057) exited with exit code 1
2026-08-11 01:40:55.535 UTC [31052] LOG: shutting down
2026-08-11 01:40:55.721 UTC [31047] LOG: database system is shut down
2026-08-11T01:40:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57797 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:40:55 dist-test-slave-0kls krb5kdc[32746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:40:55 dist-test-slave-0kls krb5kdc[32746](info): set up 2 sockets
Aug 11 01:40:55 dist-test-slave-0kls krb5kdc[32746](info): commencing operation
krb5kdc: starting...
W20260811 01:40:57.033735 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:40:57 dist-test-slave-0kls krb5kdc[32746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:40:57.359500 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36805
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:40:57.729282 32759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:57.729655 32759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:57.729872 32759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:57.737339 32759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:40:57.737505 32759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:57.737619 32759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:57.737736 32759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:40:57.737851 32759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:40:57.748641 32759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:57.750289 32759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:57.751680 32759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:57.764707 32767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:57.764804 32765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:57.764804 301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:57.766182 32759 server_base.cc:1034] running on GCE node
I20260811 01:40:57.767019 32759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:57.768538 32759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:57.769773 32759 hybrid_clock.cc:648] HybridClock initialized: now 1786412457769711 us; error 40 us; skew 500 ppm
I20260811 01:40:57.770231 32759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:57 dist-test-slave-0kls krb5kdc[32746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:57.773594 32759 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:40:57.775345 32759 webserver.cc:460] Webserver started at http://127.17.132.62:44515/ using document root <none> and password file <none>
I20260811 01:40:57.776120 32759 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:57.776259 32759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:57.776604 32759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:40:57.779829 32759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "7910255b8eb6476dbb8190eaa784f951"
format_stamp: "Formatted at 2026-08-11 01:40:57 on dist-test-slave-0kls"
server_key: "c4c2024c08d82237f7113347e5bb5cd9"
server_key_iv: "40b1173a728a6e29cf2b4bd2c499dc57"
server_key_version: "encryptionkey@0"
I20260811 01:40:57.780755 32759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "7910255b8eb6476dbb8190eaa784f951"
format_stamp: "Formatted at 2026-08-11 01:40:57 on dist-test-slave-0kls"
server_key: "c4c2024c08d82237f7113347e5bb5cd9"
server_key_iv: "40b1173a728a6e29cf2b4bd2c499dc57"
server_key_version: "encryptionkey@0"
I20260811 01:40:57.786041 32759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:40:57.789538 310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:57.790956 32759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:40:57.791167 32759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "7910255b8eb6476dbb8190eaa784f951"
format_stamp: "Formatted at 2026-08-11 01:40:57 on dist-test-slave-0kls"
server_key: "c4c2024c08d82237f7113347e5bb5cd9"
server_key_iv: "40b1173a728a6e29cf2b4bd2c499dc57"
server_key_version: "encryptionkey@0"
I20260811 01:40:57.791368 32759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:57.803593 32759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:57.808152 32759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:57.808476 32759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:57.829099 32759 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:36805
I20260811 01:40:57.829131 370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:36805 every 8 connection(s)
I20260811 01:40:57.830636 32759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:40:57.834575 371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:57.841059 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 32759
I20260811 01:40:57.841322 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:40:57.842214 17936 external_mini_cluster.cc:1428] Setting key eee8286622f2081ddd3b196dcf9176f3
I20260811 01:40:57.841359 371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:40:57 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:57.866815 374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.846508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56960 (local address 127.17.132.62:36805)
0811 01:40:57.847238 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:57.847249 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:57.847307 (+ 58us) server_negotiation.cc:407] Connection header received
0811 01:40:57.848566 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:57.848576 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:57.848863 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:57.849088 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:57.850286 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:57.852181 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:57.854226 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:57.854762 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:57.854892 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:57.859094 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:57.859102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:57.859115 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:57.859149 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:57.862227 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:57.862944 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:57.862950 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:57.862953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:57.863102 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:57.863512 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:57.863519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:57.863526 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:57.864044 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:57.864266 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:57.864803 (+ 537us) server_negotiation.cc:299] Negotiation successful
0811 01:40:57.865226 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":470,"thread_start_us":293,"threads_started":1}
I20260811 01:40:57.866834 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.845195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36805 (local address 127.0.0.1:56960)
0811 01:40:57.846062 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.846123 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:57.848170 (+ 2047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:57.849107 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:57.849112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:57.849674 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:57.850091 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:57.850110 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:57.852359 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:57.852363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:57.854063 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:57.854081 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:57.855026 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:57.855035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:57.855277 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:57.855998 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:57.856032 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:57.858858 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:57.862368 (+ 3510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:57.862380 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:57.862393 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:57.862798 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:57.863231 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:57.863236 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:57.863239 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:57.863399 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:57.864196 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:57.864204 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:57.864418 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 01:40:57.864676 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 01:40:57.865346 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":172,"thread_start_us":362,"threads_started":1}
WARNING: no policy specified for kudu/127.17.132.61@KRBTEST.COM; defaulting to no policy
I20260811 01:40:57.870226 371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:40:57.871407 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.870908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49364)
0811 01:40:57.871108 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.871276 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 01:40:57.871707 311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.61@KRBTEST.COM" created.
I20260811 01:40:57.873631 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.873103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49372)
0811 01:40:57.873307 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.873405 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 01:40:57.873906 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:37637: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
I20260811 01:40:57.904808 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:37637
--webserver_interface=127.17.132.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:40:57.923348 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } attempt: 1
I20260811 01:40:57.924666 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.924150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49388)
0811 01:40:57.924351 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.924506 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:40:57.925756 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.925416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49400)
0811 01:40:57.925554 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.925621 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:40:57.926084 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:37637: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
I20260811 01:40:57.994326 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } attempt: 2
I20260811 01:40:57.995606 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.995094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49408)
0811 01:40:57.995373 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.995463 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:40:57.996735 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:57.996364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49418)
0811 01:40:57.996535 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:57.996601 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 01:40:57.996920 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:37637: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
I20260811 01:40:58.088243 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } attempt: 3
I20260811 01:40:58.089537 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.089072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49424)
0811 01:40:58.089288 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.089404 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 01:40:58.090750 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.090370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49428)
0811 01:40:58.090533 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.090601 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 01:40:58.090935 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:37637: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
I20260811 01:40:58.234184 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } attempt: 4
I20260811 01:40:58.235486 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.234937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49434)
0811 01:40:58.235264 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.235350 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260811 01:40:58.236518 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.236167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49438)
0811 01:40:58.236320 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.236404 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:40:58.236702 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:37637: Network error: Client connection negotiation failed: client connection to 127.17.132.61:37637: connect: Connection refused (error 111)
W20260811 01:40:58.256999 379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:58.257347 379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:58.257509 379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:58.264993 379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:40:58.265134 379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:58.265257 379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:58.265362 379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:40:58.265451 379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:40:58.275543 379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:37637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.132.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:58.276875 379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:58.278229 379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:58.290380 386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:58.290339 387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:58.290406 389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:58.291541 379 server_base.cc:1034] running on GCE node
I20260811 01:40:58.292382 379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:58.293853 379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:58.295095 379 hybrid_clock.cc:648] HybridClock initialized: now 1786412458295038 us; error 47 us; skew 500 ppm
I20260811 01:40:58.295464 379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:58.298774 379 init.cc:377] Logged in from keytab as kudu/127.17.132.61@KRBTEST.COM (short username kudu)
I20260811 01:40:58.300426 379 webserver.cc:460] Webserver started at http://127.17.132.61:39419/ using document root <none> and password file <none>
I20260811 01:40:58.301156 379 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:58.301314 379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:58.301633 379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:40:58.304848 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data/instance:
uuid: "cc700f70e70843a2bc5bbd50ca063682"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7746aa381c1889b88cc27c58b02c4b7d"
server_key_iv: "a40d8e84c1d061b7ce57b90ce57c6498"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.305709 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal/instance:
uuid: "cc700f70e70843a2bc5bbd50ca063682"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7746aa381c1889b88cc27c58b02c4b7d"
server_key_iv: "a40d8e84c1d061b7ce57b90ce57c6498"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.311093 379 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:40:58.314694 396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:58.316042 379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:40:58.316247 379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "cc700f70e70843a2bc5bbd50ca063682"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7746aa381c1889b88cc27c58b02c4b7d"
server_key_iv: "a40d8e84c1d061b7ce57b90ce57c6498"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.316459 379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:58.333159 379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:58.337302 379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:58.337613 379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:58.356832 379 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.61:37637
I20260811 01:40:58.356864 451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.61:37637 every 8 connection(s)
I20260811 01:40:58.358299 379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
I20260811 01:40:58.362461 452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:58.363415 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 379
I20260811 01:40:58.363662 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-1/wal/instance
I20260811 01:40:58.364306 17936 external_mini_cluster.cc:1428] Setting key 5d6c80123632a392a6e856729a066157
I20260811 01:40:58.373474 452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.60@KRBTEST.COM" created.
I20260811 01:40:58.395732 456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.377199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56972 (local address 127.17.132.62:36805)
0811 01:40:58.377724 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.377729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.378875 (+ 1146us) server_negotiation.cc:407] Connection header received
0811 01:40:58.380789 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.380795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.380887 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.381008 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.382596 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.383306 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.384860 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.385280 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.385414 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.389100 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.389106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.389109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.389157 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.392006 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.392865 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.392870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.392872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.392992 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.393504 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.393508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.393510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.393845 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.394023 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.395026 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.395275 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":296,"threads_started":1}
I20260811 01:40:58.397003 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.377934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36805 (local address 127.0.0.1:56972)
0811 01:40:58.378710 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.378755 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.380520 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.381267 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.381275 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.381841 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.382402 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.382419 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.383477 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.383481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.384715 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.384727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.385529 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.385537 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.385759 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.386533 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.386556 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.388858 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.392167 (+ 3309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.392177 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.392196 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.392727 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.393107 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.393112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.393116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.393368 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.393988 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.393996 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.394413 (+ 417us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.394768 (+ 355us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.395399 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":323,"threads_started":1}
I20260811 01:40:58.398974 452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:40:58.415235 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.399851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49452)
0811 01:40:58.400144 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.400163 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.400267 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.401277 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.401284 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.401865 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.402083 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.402098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.403919 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.403927 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.405338 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.405352 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.406256 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.406261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.406520 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.407133 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.407155 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.409158 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.412523 (+ 3365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.412531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.412534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.412929 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.413318 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.413323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.413327 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.413480 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.414186 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.414192 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.414345 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.414501 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.414805 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":37}
I20260811 01:40:58.415292 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.400074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49452 (local address 127.17.132.61:37637)
0811 01:40:58.400803 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.400813 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.400840 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:40:58.400889 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.400898 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.401103 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.401238 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.402259 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.403765 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.405490 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.406106 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.406245 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.409389 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.409402 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.409418 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.409447 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.412381 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.413077 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.413084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.413086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.413201 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.413589 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.413595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.413598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.414059 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.414289 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.414644 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.414915 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":545,"thread_start_us":401,"threads_started":1}
I20260811 01:40:58.418233 452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:40:58.419446 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.418969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56864)
0811 01:40:58.419162 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.419288 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 01:40:58.419696 399 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.421767 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.421316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56874)
0811 01:40:58.421548 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.421647 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:40:58.422056 452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
I20260811 01:40:58.428995 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:37639
--webserver_interface=127.17.132.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:40:58.471388 452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 1
I20260811 01:40:58.472671 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.472183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56884)
0811 01:40:58.472397 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.472505 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 01:40:58.473673 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.473315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56896)
0811 01:40:58.473488 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.473556 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:40:58.473932 452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.535972 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } attempt: 5
I20260811 01:40:58.542136 452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 2
I20260811 01:40:58.543099 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.542696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56906)
0811 01:40:58.542869 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.542959 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:40:58.544324 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.543798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56914)
0811 01:40:58.544017 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.544123 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260811 01:40:58.544618 452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.551581 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.536754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49468)
0811 01:40:58.536981 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.537009 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.537113 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.537490 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.537493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.537953 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.538141 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.538152 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.539540 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.539544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.540418 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.540429 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.541434 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.541438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.541587 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.542339 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.542364 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.544980 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.549091 (+ 4111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.549095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.549098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.549499 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.549984 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.549988 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.549990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.550129 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.550747 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.550750 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.550881 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.551077 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.551326 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:40:58.551738 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.536894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.17.132.61:37637)
0811 01:40:58.537104 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.537111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.537135 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:40:58.537226 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.537231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.537345 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.537447 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.538328 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.539403 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.540571 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.541281 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.541411 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.545168 (+ 3757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.545175 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.545180 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.545219 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.548885 (+ 3666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.549633 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.549638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.549642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.549842 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.550250 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.550255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.550258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.550628 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.550782 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.551209 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.551455 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:40:58.552824 371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:40:58.554035 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.553587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56924)
0811 01:40:58.553775 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.553893 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 01:40:58.555135 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.554751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56940)
0811 01:40:58.554926 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.555018 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 01:40:58.555392 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.606650 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 1
I20260811 01:40:58.607978 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.607462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56952)
0811 01:40:58.607671 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.607777 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:40:58.609365 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.608954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56966)
0811 01:40:58.609164 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.609242 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260811 01:40:58.609731 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.635906 452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 3
I20260811 01:40:58.637360 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.636722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56974)
0811 01:40:58.637005 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.637135 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 01:40:58.638692 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.638167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56988)
0811 01:40:58.638426 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.638526 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260811 01:40:58.638926 452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.678037 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 2
I20260811 01:40:58.679425 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.678872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:56998)
0811 01:40:58.679162 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.679256 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 01:40:58.680621 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.680240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57000)
0811 01:40:58.680407 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.680493 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:40:58.680850 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.782155 452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 4
I20260811 01:40:58.783464 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.782820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57008)
0811 01:40:58.783143 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.783255 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 01:40:58.784536 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.784119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57014)
0811 01:40:58.784314 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.784403 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260811 01:40:58.784780 452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
I20260811 01:40:58.787088 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 3
I20260811 01:40:58.788267 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.787769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57024)
0811 01:40:58.787958 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.788073 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 01:40:58.789472 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.789008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57040)
0811 01:40:58.789286 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.789366 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260811 01:40:58.789690 371 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:37639: Network error: Client connection negotiation failed: client connection to 127.17.132.60:37639: connect: Connection refused (error 111)
W20260811 01:40:58.795827 461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:40:58.796159 461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:40:58.796357 461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:40:58.804034 461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:40:58.804159 461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:40:58.804242 461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:40:58.804330 461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:40:58.804433 461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:40:58.814813 461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36805,127.17.132.61:37637,127.17.132.60:37639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:37639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.132.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:40:58.816291 461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:40:58.817633 461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:40:58.830689 470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:40:58.830718 467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:58.832048 461 server_base.cc:1034] running on GCE node
W20260811 01:40:58.837045 468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:40:58.838145 461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:40:58.839735 461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:40:58.840972 461 hybrid_clock.cc:648] HybridClock initialized: now 1786412458840892 us; error 76 us; skew 500 ppm
I20260811 01:40:58.841393 461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:40:58.844939 461 init.cc:377] Logged in from keytab as kudu/127.17.132.60@KRBTEST.COM (short username kudu)
I20260811 01:40:58.846688 461 webserver.cc:460] Webserver started at http://127.17.132.60:39835/ using document root <none> and password file <none>
I20260811 01:40:58.847512 461 fs_manager.cc:359] Metadata directory not provided
I20260811 01:40:58.847628 461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:40:58.847903 461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:40:58.851298 461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data/instance:
uuid: "6f3d54238b124bf38d50f97dad165388"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7f4b5d260f10eaf153a1f474a64fa463"
server_key_iv: "801b4fd77202cdd48ec0498559a0a70f"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.852172 461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal/instance:
uuid: "6f3d54238b124bf38d50f97dad165388"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7f4b5d260f10eaf153a1f474a64fa463"
server_key_iv: "801b4fd77202cdd48ec0498559a0a70f"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.858319 461 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:40:58.862210 477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:40:58.863895 461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:40:58.864167 461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "6f3d54238b124bf38d50f97dad165388"
format_stamp: "Formatted at 2026-08-11 01:40:58 on dist-test-slave-0kls"
server_key: "7f4b5d260f10eaf153a1f474a64fa463"
server_key_iv: "801b4fd77202cdd48ec0498559a0a70f"
server_key_version: "encryptionkey@0"
I20260811 01:40:58.864429 461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:40:58.885579 461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:40:58.890440 461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:40:58.890703 461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:40:58.910457 461 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.60:37639
I20260811 01:40:58.910502 538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.60:37639 every 8 connection(s)
I20260811 01:40:58.911890 461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
I20260811 01:40:58.915652 539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:40:58.918790 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 461
I20260811 01:40:58.919023 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786412236095684-17936-0/minicluster-data/master-2/wal/instance
I20260811 01:40:58.919616 17936 external_mini_cluster.cc:1428] Setting key 5561770c253ac0db798bde5e8c658e49
I20260811 01:40:58.924609 539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:58.943003 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.927468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56988 (local address 127.17.132.62:36805)
0811 01:40:58.927998 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.928005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.928649 (+ 644us) server_negotiation.cc:407] Connection header received
0811 01:40:58.928847 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.928853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.928949 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.929055 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.930289 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.930995 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.932629 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.933058 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.933202 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.936952 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.936958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.936961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.937007 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.939766 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.940557 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.940566 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.940572 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.940722 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.941175 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.941186 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.941189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.941469 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.941657 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.942325 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.942575 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":259,"threads_started":1}
I20260811 01:40:58.944264 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.922037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57052 (local address 127.17.132.60:37639)
0811 01:40:58.922936 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.922949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.922991 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:40:58.924766 (+ 1775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.924790 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.925215 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.925614 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.927414 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.929228 (+ 1814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.930736 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.931418 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.931621 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.936234 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.936243 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.936258 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.936294 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.939551 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.940368 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.940376 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.940378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.940541 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.940958 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.940962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.940964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.941554 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.941930 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.942287 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.942692 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":420,"threads_started":1}
I20260811 01:40:58.944283 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.927474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36805 (local address 127.0.0.1:56988)
0811 01:40:58.928489 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.928532 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.928711 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.929135 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.929140 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.929773 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.930115 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.930125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.931172 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.931176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.932468 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.932492 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.933315 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.933323 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.933490 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.934165 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.934189 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.936714 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.939913 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.939928 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.939942 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.940391 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.940846 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.940851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.940854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.941046 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.941612 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.941620 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.941939 (+ 319us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.942201 (+ 262us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.942910 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"mutex_wait_us":209,"thread_start_us":597,"threads_started":1}
I20260811 01:40:58.946237 539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:40:58.961671 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.947150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:37637 (local address 127.0.0.1:49484)
0811 01:40:58.947389 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.947404 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.947549 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.947912 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.947916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.948426 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.948647 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.948663 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.949754 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.949760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.950845 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.950858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.951629 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.951635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.951870 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.952471 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.952500 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.955130 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.958830 (+ 3700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.958837 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.958842 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.959407 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.959853 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.959859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.959865 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.960047 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.960616 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.960621 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.960805 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.960958 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.961278 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260811 01:40:58.961701 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.947141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49484 (local address 127.17.132.61:37637)
0811 01:40:58.947398 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.947403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.947486 (+ 83us) server_negotiation.cc:407] Connection header received
0811 01:40:58.947679 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.947686 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.947761 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.947876 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.948826 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.949596 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.951002 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.951467 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.951566 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.955361 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.955367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.955370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.955411 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.958685 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.959552 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.959556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.959559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.959707 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.960202 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.960206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.960208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.960482 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.960657 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.961067 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.961303 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:40:58.962885 539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:40:58.965581 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.948122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56996 (local address 127.17.132.62:36805)
0811 01:40:58.948315 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.948319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.948377 (+ 58us) server_negotiation.cc:407] Connection header received
0811 01:40:58.948584 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.948587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.948659 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.948770 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.950227 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.950942 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.952570 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.953013 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.953110 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.958375 (+ 5265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.958386 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.958389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.958427 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.961413 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.962545 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.962552 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.962556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.962732 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.963185 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.963190 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.963194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.964277 (+ 1083us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.964604 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.964961 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.965225 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:40:58.966948 371 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 4
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:40:58.978379 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.963733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57056)
0811 01:40:58.963894 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.963914 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.964015 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.964387 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.964392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.964926 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.965102 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.965117 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.966227 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.966234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.967077 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.967088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.967971 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.967976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.968184 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.968870 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.968901 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.972049 (+ 3148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.975685 (+ 3636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.975693 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.975697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.976084 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.976448 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.976456 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.976460 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.976595 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.977203 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.977208 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.977361 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.977515 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.977929 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 01:40:58.979106 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.963982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57056 (local address 127.17.132.60:37639)
0811 01:40:58.964132 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.964136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.964150 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:40:58.964191 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.964194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.964245 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.964321 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.965267 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.966100 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.967220 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.967855 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.967966 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.972239 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.972245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.972252 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.972287 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.975548 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.976211 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.976218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.976226 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.976340 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.976704 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.976711 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.976714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.977085 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.977240 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.977608 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.978728 (+ 1120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":873,"server-negotiator.queue_time_us":52}
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:40:58.985157 539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: Bootstrap starting.
Aug 11 01:40:58 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412457, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:40:58.987259 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.967776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49490 (local address 127.17.132.61:37637)
0811 01:40:58.967953 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.967959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.968142 (+ 183us) server_negotiation.cc:407] Connection header received
0811 01:40:58.968312 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.968317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.968390 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.968508 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.970224 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.971055 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.973550 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.974194 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.974351 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.980627 (+ 6276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.980633 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.980636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.980679 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.983933 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.984840 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.984847 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.984850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.985025 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.985532 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.985538 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.985541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.985965 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.986251 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.986618 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.986873 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:40:58.989812 539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:58.991358 539 log.cc:824] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:58.992671 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:40:58.995438 539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: No bootstrap required, opened a new log
I20260811 01:40:58.996300 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.967486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57062)
0811 01:40:58.967685 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:58.967705 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:58.967803 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:58.978996 (+ 11193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:58.979003 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:58.979584 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:58.979859 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.979877 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.981754 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.981762 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.983364 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:58.983388 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.984326 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.984332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:58.984540 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.985194 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:58.985212 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:58.987964 (+ 2752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:58.992971 (+ 5007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.992977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.992981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.993612 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.994099 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:58.994104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:58.994108 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:58.994299 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:58.995119 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:58.995124 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:58.995317 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 01:40:58.995502 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 01:40:58.995869 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 01:40:58.996613 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:58.968183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.17.132.60:37639)
0811 01:40:58.978386 (+ 10203us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:58.978393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:58.978420 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:40:58.978473 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:58.978480 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:58.978718 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:58.978907 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:58.980068 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.981585 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.983540 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:58.984155 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:58.984289 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:58.988181 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:58.988191 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:58.988198 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:58.988240 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:58.992763 (+ 4523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.993757 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.993763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.993767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.993956 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:58.994430 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:58.994437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:58.994441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:58.994952 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:58.995135 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:58.995642 (+ 507us) server_negotiation.cc:299] Negotiation successful
0811 01:40:58.995908 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10048,"thread_start_us":9820,"threads_started":1}
I20260811 01:40:59.004284 371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: Bootstrap starting.
I20260811 01:40:59.004657 539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.005318 539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:59.005525 539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3d54238b124bf38d50f97dad165388, State: Initialized, Role: FOLLOWER
I20260811 01:40:59.006803 539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.010138 371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:59.012009 371 log.cc:824] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:59.013015 539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:40:59.021585 556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.023693 556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.028271 371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: No bootstrap required, opened a new log
I20260811 01:40:59.045396 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:59.005240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.17.132.61:37637)
0811 01:40:59.007018 (+ 1778us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:59.007024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:59.015453 (+ 8429us) server_negotiation.cc:407] Connection header received
0811 01:40:59.015896 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:59.015907 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:59.016020 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:59.016112 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:59.027967 (+ 11855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.029062 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.031419 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.032111 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.032232 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:59.036772 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:59.036783 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:59.036791 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:59.036858 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:59.041245 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.042216 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.042222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.042226 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.042404 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.042903 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.042910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.042916 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.043345 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:59.043602 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:59.044718 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0811 01:40:59.044985 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1600}
I20260811 01:40:59.047613 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:59.004785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.17.132.62:36805)
0811 01:40:59.004996 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:59.005003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:59.016457 (+ 11454us) server_negotiation.cc:407] Connection header received
0811 01:40:59.017166 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:59.017176 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:59.017288 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:59.017383 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:59.020312 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.021949 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.026084 (+ 4135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.026805 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.026922 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:59.040456 (+ 13534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:59.040464 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:59.040469 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:59.040518 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:59.044202 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.045074 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.045082 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.045086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.045249 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.045732 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.045737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.045740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.046123 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:59.046414 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:59.047010 (+ 596us) server_negotiation.cc:299] Negotiation successful
0811 01:40:59.047262 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:40:59.047684 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:59.012265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57070 (local address 127.17.132.60:37639)
0811 01:40:59.012515 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:59.012526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:59.023222 (+ 10696us) server_negotiation.cc:407] Connection header received
0811 01:40:59.024407 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:59.024416 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:59.024561 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:59.024659 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:59.027763 (+ 3104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.029254 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.032579 (+ 3325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.033575 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.033726 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:59.038113 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:59.038121 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:59.038125 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:59.038181 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:59.043237 (+ 5056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.044441 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.044449 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.044455 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.044659 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.045232 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.045251 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.045257 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.045739 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:59.046073 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:59.046900 (+ 827us) server_negotiation.cc:299] Negotiation successful
0811 01:40:59.047172 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:40:59.051512 371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.051955 371 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:59.052083 371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7910255b8eb6476dbb8190eaa784f951, State: Initialized, Role: FOLLOWER
I20260811 01:40:59.052801 371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.054658 572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.055212 572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.055390 371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:40:59.061527 316 tablet.cc:2369] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:40:59.054921 461 master_runner.cc:186] Error getting master registration for 127.17.132.62:36805: OK, instance_id { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" instance_seqno: 1786412457823151 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:40:59.069582 461 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:40:59.072734 571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:40:59.072916 571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 01:40:59.075490 584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:40:59.075670 584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:40:59.065372 32759 master_runner.cc:186] Error getting master registration for 127.17.132.61:37637: OK, instance_id { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" instance_seqno: 1786412458351308 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:40:59.078307 32759 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:40:59.084023 452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } attempt: 5
Aug 11 01:40:59 dist-test-slave-0kls krb5kdc[32746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:40:59.106026 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:59.084657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:37639 (local address 127.0.0.1:57072)
0811 01:40:59.084933 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 01:40:59.084954 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:40:59.085065 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:40:59.085620 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:40:59.085625 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:40:59.086224 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:40:59.086474 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:59.086488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.088093 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.088100 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:59.089601 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:40:59.089619 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.092589 (+ 2970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.092597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:40:59.092857 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:59.093672 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:40:59.093703 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:40:59.097196 (+ 3493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:40:59.102279 (+ 5083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:59.102286 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:59.102290 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:59.102942 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:59.103526 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:40:59.103533 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:40:59.103540 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:40:59.103731 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:40:59.104593 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:40:59.104599 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:40:59.104932 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 01:40:59.105138 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 01:40:59.105554 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260811 01:40:59.107369 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:40:59.084876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.17.132.60:37639)
0811 01:40:59.085098 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:40:59.085106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:40:59.085140 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:40:59.085205 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:40:59.085212 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:40:59.085293 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:40:59.085418 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:40:59.086673 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.087911 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.089833 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:40:59.090597 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:40:59.090755 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:40:59.097557 (+ 6802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:40:59.097566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:40:59.097576 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:40:59.097651 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:40:59.102046 (+ 4395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.103132 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.103138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.103143 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.103336 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:40:59.103891 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:40:59.103897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:40:59.103900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:40:59.104317 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:40:59.104518 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:40:59.106651 (+ 2133us) server_negotiation.cc:299] Negotiation successful
0811 01:40:59.106953 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:40:59.114498 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: Bootstrap starting.
I20260811 01:40:59.121613 452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: Neither blocks nor log segments found. Creating new log.
I20260811 01:40:59.123255 452 log.cc:824] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: Log is configured to *not* fsync() on all Append() calls
I20260811 01:40:59.129559 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: No bootstrap required, opened a new log
I20260811 01:40:59.142648 452 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
W20260811 01:40:59.143034 486 tablet.cc:2369] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:40:59.143357 452 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:40:59.143566 452 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc700f70e70843a2bc5bbd50ca063682, State: Initialized, Role: FOLLOWER
I20260811 01:40:59.144554 452 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.150259 589 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.150861 589 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.151937 452 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:40:59.171550 379 master_runner.cc:263] No leader master found from master cc700f70e70843a2bc5bbd50ca063682
I20260811 01:40:59.171761 379 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:40:59.175129 604 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:40:59.175428 604 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:40:59.201941 572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:40:59.202283 572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.203997 572 leader_election.cc:288] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc700f70e70843a2bc5bbd50ca063682 (127.17.132.61:37637), 6f3d54238b124bf38d50f97dad165388 (127.17.132.60:37639)
I20260811 01:40:59.205152 425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7910255b8eb6476dbb8190eaa784f951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc700f70e70843a2bc5bbd50ca063682" is_pre_election: true
I20260811 01:40:59.207469 507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7910255b8eb6476dbb8190eaa784f951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3d54238b124bf38d50f97dad165388" is_pre_election: true
I20260811 01:40:59.208160 507 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7910255b8eb6476dbb8190eaa784f951 in term 0.
I20260811 01:40:59.209071 425 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7910255b8eb6476dbb8190eaa784f951 in term 0.
I20260811 01:40:59.209849 311 leader_election.cc:302] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7910255b8eb6476dbb8190eaa784f951, cc700f70e70843a2bc5bbd50ca063682; no voters:
I20260811 01:40:59.211159 572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:40:59.211333 572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:40:59.211457 572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:59.215394 572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.216765 425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7910255b8eb6476dbb8190eaa784f951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc700f70e70843a2bc5bbd50ca063682"
I20260811 01:40:59.217013 425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:59.224402 425 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7910255b8eb6476dbb8190eaa784f951 in term 1.
I20260811 01:40:59.231009 311 leader_election.cc:302] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7910255b8eb6476dbb8190eaa784f951, cc700f70e70843a2bc5bbd50ca063682; no voters:
I20260811 01:40:59.234833 507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7910255b8eb6476dbb8190eaa784f951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3d54238b124bf38d50f97dad165388"
I20260811 01:40:59.235087 507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:40:59.238782 507 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7910255b8eb6476dbb8190eaa784f951 in term 1.
I20260811 01:40:59.239653 572 leader_election.cc:288] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [CANDIDATE]: Term 1 election: Requested vote from peers cc700f70e70843a2bc5bbd50ca063682 (127.17.132.61:37637), 6f3d54238b124bf38d50f97dad165388 (127.17.132.60:37639)
I20260811 01:40:59.240216 572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:40:59.240728 572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [term 1 LEADER]: Becoming Leader. State: Replica: 7910255b8eb6476dbb8190eaa784f951, State: Running, Role: LEADER
I20260811 01:40:59.241669 572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } }
I20260811 01:40:59.260469 606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7910255b8eb6476dbb8190eaa784f951. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.261024 606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:59.274406 608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:40:59.276892 608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:40:59.299817 507 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [term 1 FOLLOWER]: Refusing update from remote peer 7910255b8eb6476dbb8190eaa784f951: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:40:59.299924 425 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [term 1 FOLLOWER]: Refusing update from remote peer 7910255b8eb6476dbb8190eaa784f951: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:40:59.300973 572 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:40:59.301723 572 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:40:59.339131 556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7910255b8eb6476dbb8190eaa784f951. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.339531 556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:40:59.342859 402 tablet.cc:2369] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:40:59.351174 612 mvcc.cc:205] Tried to move back new op lower bound from 7317145433278951424 to 7317145433067368448. Current Snapshot: MvccSnapshot[applied={T|T < 7317145433278951424}]
I20260811 01:40:59.359953 572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.360347 572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:59.365846 556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.366168 556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.366225 608 catalog_manager.cc:1347] Generated new cluster ID: 1cdea0c8ee1d4534909b45c7ad41f380
I20260811 01:40:59.366323 608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:40:59.379462 589 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7910255b8eb6476dbb8190eaa784f951. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.379873 589 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.383189 606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.383474 606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951 [sys.catalog]: This master's current role is: LEADER
I20260811 01:40:59.386646 610 mvcc.cc:205] Tried to move back new op lower bound from 7317145433278951424 to 7317145433067368448. Current Snapshot: MvccSnapshot[applied={T|T < 7317145433278951424}]
I20260811 01:40:59.393997 608 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:40:59.396651 608 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:40:59.399369 589 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7910255b8eb6476dbb8190eaa784f951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7910255b8eb6476dbb8190eaa784f951" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36805 } } peers { permanent_uuid: "cc700f70e70843a2bc5bbd50ca063682" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 37637 } } peers { permanent_uuid: "6f3d54238b124bf38d50f97dad165388" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 37639 } } }
I20260811 01:40:59.399672 589 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:40:59.420423 608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7910255b8eb6476dbb8190eaa784f951: Generated new TSK 0
I20260811 01:40:59.421674 608 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:41:00.075007 571 catalog_manager.cc:1259] Loaded cluster ID: 1cdea0c8ee1d4534909b45c7ad41f380
I20260811 01:41:00.075163 571 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: loading cluster ID for follower catalog manager: success
I20260811 01:41:00.077694 571 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: acquiring CA information for follower catalog manager: success
I20260811 01:41:00.079589 571 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f3d54238b124bf38d50f97dad165388: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:41:00.177556 604 catalog_manager.cc:1259] Loaded cluster ID: 1cdea0c8ee1d4534909b45c7ad41f380
I20260811 01:41:00.177662 604 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: loading cluster ID for follower catalog manager: success
I20260811 01:41:00.180234 604 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: acquiring CA information for follower catalog manager: success
I20260811 01:41:00.182133 604 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cc700f70e70843a2bc5bbd50ca063682: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:41:00.570170 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 32759
I20260811 01:41:00.572079 366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:00.687276 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 32759
I20260811 01:41:00.714176 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 379
I20260811 01:41:00.715384 446 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:00.823194 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 379
I20260811 01:41:00.848003 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 461
I20260811 01:41:00.849159 534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:00.959007 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 461
2026-08-11T01:41:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5107 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:41:01 dist-test-slave-0kls krb5kdc[632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:41:01 dist-test-slave-0kls krb5kdc[632](info): set up 2 sockets
Aug 11 01:41:01 dist-test-slave-0kls krb5kdc[632](info): commencing operation
krb5kdc: starting...
W20260811 01:41:02.168174 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:41:02 dist-test-slave-0kls krb5kdc[632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:41:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:41:02.477766 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43647
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:02.835592 648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:02.835919 648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:02.836089 648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:02.843777 648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:02.843909 648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:02.844022 648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:02.844141 648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:02.844206 648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:02.854597 648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:02.856107 648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:02.857539 648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:02.870451 653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:02.870420 654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:02.870399 656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:02.872087 648 server_base.cc:1034] running on GCE node
I20260811 01:41:02.872998 648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:02.874660 648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:02.875912 648 hybrid_clock.cc:648] HybridClock initialized: now 1786412462875864 us; error 39 us; skew 500 ppm
I20260811 01:41:02.876292 648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:02 dist-test-slave-0kls krb5kdc[632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412462, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:02.885015 648 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:02.887060 648 webserver.cc:460] Webserver started at http://127.17.132.62:42275/ using document root <none> and password file <none>
I20260811 01:41:02.887884 648 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:02.888049 648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:02.888404 648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:02.891850 648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "0fb1ec7474bf4e5480b4c59a385f3981"
format_stamp: "Formatted at 2026-08-11 01:41:02 on dist-test-slave-0kls"
server_key: "1ba193562069e204133d1299f38c3090"
server_key_iv: "dfa7451304a2328f1e8f49c69947d15c"
server_key_version: "encryptionkey@0"
I20260811 01:41:02.892679 648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "0fb1ec7474bf4e5480b4c59a385f3981"
format_stamp: "Formatted at 2026-08-11 01:41:02 on dist-test-slave-0kls"
server_key: "1ba193562069e204133d1299f38c3090"
server_key_iv: "dfa7451304a2328f1e8f49c69947d15c"
server_key_version: "encryptionkey@0"
I20260811 01:41:02.899041 648 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:41:02.903246 663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:02.904912 648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 01:41:02.905087 648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "0fb1ec7474bf4e5480b4c59a385f3981"
format_stamp: "Formatted at 2026-08-11 01:41:02 on dist-test-slave-0kls"
server_key: "1ba193562069e204133d1299f38c3090"
server_key_iv: "dfa7451304a2328f1e8f49c69947d15c"
server_key_version: "encryptionkey@0"
I20260811 01:41:02.905292 648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:02.919516 648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:02.923868 648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:02.924141 648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:02.944077 648 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:43647
I20260811 01:41:02.944101 723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:43647 every 8 connection(s)
I20260811 01:41:02.945587 648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:02.948503 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 648
I20260811 01:41:02.948736 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:41:02.949625 17936 external_mini_cluster.cc:1428] Setting key 318bb97c0a43c82e391738b3d9a61aba
I20260811 01:41:02.949986 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:02.965063 724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981: Bootstrap starting.
Aug 11 01:41:02 dist-test-slave-0kls krb5kdc[632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:02.969260 724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:02.970707 724 log.cc:824] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:02.974479 724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981: No bootstrap required, opened a new log
I20260811 01:41:02.976104 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:02.951593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46654 (local address 127.17.132.62:43647)
0811 01:41:02.952395 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:02.952406 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:02.952448 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:41:02.954785 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:02.954812 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:02.955208 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:02.955529 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:02.957497 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:02.958838 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:02.960736 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:02.961425 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:02.961572 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:02.966734 (+ 5162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:02.966745 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:02.966765 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:02.966818 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:02.971074 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:02.972118 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:02.972124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:02.972131 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:02.972386 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:02.972762 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:02.972768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:02.972771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:02.973504 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:02.973835 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:02.974260 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 01:41:02.974712 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":379,"threads_started":1}
I20260811 01:41:02.980356 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:41:02.984699 724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } }
I20260811 01:41:02.985103 724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:02.985181 724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb1ec7474bf4e5480b4c59a385f3981, State: Initialized, Role: FOLLOWER
I20260811 01:41:02.985776 724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } }
I20260811 01:41:02.986060 724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:02.986166 724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:02.986297 724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:02.988484 724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } }
I20260811 01:41:02.988972 724 leader_election.cc:302] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fb1ec7474bf4e5480b4c59a385f3981; no voters:
I20260811 01:41:02.989523 724 leader_election.cc:288] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:41:02.989689 729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:02.990480 729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [term 1 LEADER]: Becoming Leader. State: Replica: 0fb1ec7474bf4e5480b4c59a385f3981, State: Running, Role: LEADER
I20260811 01:41:02.991071 729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } }
I20260811 01:41:02.991858 724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:02.993989 730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } } }
I20260811 01:41:02.994263 731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fb1ec7474bf4e5480b4c59a385f3981. Latest consensus state: current_term: 1 leader_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb1ec7474bf4e5480b4c59a385f3981" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43647 } } }
I20260811 01:41:02.994453 730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:02.994526 731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:02.996217 735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:03.001821 735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:03.011348 735 catalog_manager.cc:1347] Generated new cluster ID: 04be6946aa69414ba3ee3381ef285133
I20260811 01:41:03.011480 735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:41:03.060320 735 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:41:03.062263 735 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:41:03.072297 735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fb1ec7474bf4e5480b4c59a385f3981: Generated new TSK 0
I20260811 01:41:03.073347 735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:41:03.093654 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 648
I20260811 01:41:03.094915 719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:03.191970 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 648
2026-08-11T01:41:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2229 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:41:03 dist-test-slave-0kls krb5kdc[755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:41:03 dist-test-slave-0kls krb5kdc[755](info): set up 2 sockets
Aug 11 01:41:03 dist-test-slave-0kls krb5kdc[755](info): commencing operation
krb5kdc: starting...
W20260811 01:41:04.363179 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.006s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:41:04 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:41:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:41:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:41:04.665432 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:35321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:05.019304 769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:05.019619 769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:05.019713 769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:05.027153 769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:05.027283 769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:05.027333 769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:05.027392 769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:05.027438 769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:05.037689 769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:35321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:05.039093 769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:05.040448 769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:05.053170 775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:05.053191 776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:05.053399 778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:05.054057 769 server_base.cc:1034] running on GCE node
I20260811 01:41:05.054853 769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:05.056290 769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:05.057507 769 hybrid_clock.cc:648] HybridClock initialized: now 1786412465057458 us; error 32 us; skew 500 ppm
I20260811 01:41:05.057978 769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:05 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:05.061245 769 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:05.062848 769 webserver.cc:460] Webserver started at http://127.17.132.62:42237/ using document root <none> and password file <none>
I20260811 01:41:05.063572 769 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:05.063716 769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:05.064060 769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:05.067297 769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e6871af373fc45908e52fe47b2d8d7a3"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "29240ad3f8d8fb4e63df7e884b58ac22"
server_key_iv: "1cbf51f56b736f3b362a4c123500926d"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.068158 769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e6871af373fc45908e52fe47b2d8d7a3"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "29240ad3f8d8fb4e63df7e884b58ac22"
server_key_iv: "1cbf51f56b736f3b362a4c123500926d"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.073768 769 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:41:05.077433 785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:05.078894 769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:05.079092 769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e6871af373fc45908e52fe47b2d8d7a3"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "29240ad3f8d8fb4e63df7e884b58ac22"
server_key_iv: "1cbf51f56b736f3b362a4c123500926d"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.079310 769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:05.098455 769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:05.103258 769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:05.103583 769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:05.126469 769 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:35321
I20260811 01:41:05.126487 843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:35321 every 8 connection(s)
I20260811 01:41:05.128136 769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:05.132658 844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:05.136777 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 769
I20260811 01:41:05.137050 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:41:05.138022 17936 external_mini_cluster.cc:1428] Setting key 030e20f9d2f2d16449f554a261728608
I20260811 01:41:05.148109 844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap starting.
I20260811 01:41:05.151804 844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:05.153416 844 log.cc:824] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:41:05 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:05.157191 844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: No bootstrap required, opened a new log
I20260811 01:41:05.165930 847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:05.140869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34422 (local address 127.17.132.62:35321)
0811 01:41:05.141947 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:05.141961 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:05.142013 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:41:05.144106 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:05.144138 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:05.144694 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:05.145216 (+ 522us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:05.146990 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.148527 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.150099 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.150873 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.151099 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:05.156878 (+ 5779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:05.156888 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:05.156906 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:05.156950 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:05.160638 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:05.161635 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:05.161644 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:05.161652 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:05.161976 (+ 324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:05.162459 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:05.162463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:05.162465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:05.163162 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:05.163555 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:05.164114 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 01:41:05.164655 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":445,"threads_started":1}
I20260811 01:41:05.166424 844 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:05.166864 844 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:05.166994 844 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Initialized, Role: FOLLOWER
I20260811 01:41:05.167709 844 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:05.168010 844 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:05.168171 844 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:05.168380 844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:05.171245 844 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:05.171847 844 leader_election.cc:302] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6871af373fc45908e52fe47b2d8d7a3; no voters:
I20260811 01:41:05.172473 844 leader_election.cc:288] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:41:05.172621 849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:05.173389 849 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 LEADER]: Becoming Leader. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Running, Role: LEADER
I20260811 01:41:05.174069 849 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:05.174858 844 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:05.177078 850 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:05.177489 850 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:05.182165 851 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6871af373fc45908e52fe47b2d8d7a3. Latest consensus state: current_term: 1 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:05.184182 851 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:05.187243 857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:05.192111 857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:05.201213 857 catalog_manager.cc:1347] Generated new cluster ID: f76ea1b8c76a490497caa1ed0a64d7c7
I20260811 01:41:05.201351 857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:41:05.224195 857 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:41:05.225584 857 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:41:05.236109 857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Generated new TSK 0
I20260811 01:41:05.237022 857 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:41:05.321663 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:05.715186 873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:05.715523 873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:05.715621 873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:05.723227 873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:05.723356 873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:05.723479 873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:41:05.733661 873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:05.735072 873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:05.736420 873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:05.749930 878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:05.749958 881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:05.750504 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:05.750941 873 server_base.cc:1034] running on GCE node
I20260811 01:41:05.751596 873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:05.752630 873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:05.753902 873 hybrid_clock.cc:648] HybridClock initialized: now 1786412465753862 us; error 57 us; skew 500 ppm
I20260811 01:41:05.754226 873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:05 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:05.757372 873 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:41:05.758994 873 webserver.cc:460] Webserver started at http://127.17.132.1:35129/ using document root <none> and password file <none>
I20260811 01:41:05.759711 873 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:05.759889 873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:05.760203 873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:05.763216 873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "e421ec2843af405492c939b3179e20ab"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "c2a5c49fdd4e2c9a993fb71664bbae57"
server_key_iv: "e83bbfd4ce07829ab741b5510faf012f"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.764063 873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "e421ec2843af405492c939b3179e20ab"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "c2a5c49fdd4e2c9a993fb71664bbae57"
server_key_iv: "e83bbfd4ce07829ab741b5510faf012f"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.769404 873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:41:05.772984 891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:05.774535 873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:41:05.774755 873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e421ec2843af405492c939b3179e20ab"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "c2a5c49fdd4e2c9a993fb71664bbae57"
server_key_iv: "e83bbfd4ce07829ab741b5510faf012f"
server_key_version: "encryptionkey@0"
I20260811 01:41:05.775031 873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:05.788551 873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:05.793615 873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:05.794014 873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:05.795095 873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:05.796641 873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:05.796774 873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:05.796945 873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:05.797036 873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:05.834072 873 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34155
I20260811 01:41:05.834110 1014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34155 every 8 connection(s)
I20260811 01:41:05.835450 873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:41:05.839581 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 873
I20260811 01:41:05.839836 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:41:05.840648 17936 external_mini_cluster.cc:1428] Setting key e88feeb5f76406b0b3159d3c4e91847d
Aug 11 01:41:05 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:05.858182 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:05.838107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:39495 (local address 127.17.132.62:35321)
0811 01:41:05.838607 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:05.838611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:05.839652 (+ 1041us) server_negotiation.cc:407] Connection header received
0811 01:41:05.841942 (+ 2290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:05.841947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:05.842029 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:05.842138 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:05.844095 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.844829 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.846554 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.846942 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.847096 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:05.851305 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:05.851311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:05.851315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:05.851350 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:05.854454 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:05.855362 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:05.855371 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:05.855377 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:05.855540 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:05.855982 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:05.855990 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:05.855996 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:05.856426 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:05.856580 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:05.857346 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 01:41:05.857616 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":261,"threads_started":1}
I20260811 01:41:05.859022 1018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:05.838693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:39495)
0811 01:41:05.839444 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:05.839504 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:05.841615 (+ 2111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:05.842435 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:05.842449 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:05.843213 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:05.843835 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:05.843854 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.845005 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.845011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:05.846386 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:05.846399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:05.847197 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:05.847205 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:05.847491 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:05.848245 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:05.848269 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:05.851021 (+ 2752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:05.854669 (+ 3648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:05.854678 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:05.854693 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:05.855203 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:05.855656 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:05.855659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:05.855662 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:05.855858 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:05.856567 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:05.856573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:05.856944 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 01:41:05.857177 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 01:41:05.857710 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":311,"threads_started":1}
I20260811 01:41:05.860704 1015 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:05.861043 1015 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:05.861882 1015 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:05.864149 807 ts_manager.cc:194] Registered new tserver with Master: e421ec2843af405492c939b3179e20ab (127.17.132.1:34155)
I20260811 01:41:05.865640 807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:39495
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:41:05.908795 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:06.268456 1021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:06.268818 1021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:06.268980 1021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:06.276870 1021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:06.277040 1021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:06.277220 1021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:41:06.287678 1021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:06.289110 1021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:06.290496 1021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:06.304535 1029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:06.304538 1031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:06.304783 1028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:06.305116 1021 server_base.cc:1034] running on GCE node
I20260811 01:41:06.306174 1021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:06.307189 1021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:06.308423 1021 hybrid_clock.cc:648] HybridClock initialized: now 1786412466308355 us; error 58 us; skew 500 ppm
I20260811 01:41:06.308763 1021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:06 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412466, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:06.312081 1021 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:41:06.313549 1021 webserver.cc:460] Webserver started at http://127.17.132.2:36135/ using document root <none> and password file <none>
I20260811 01:41:06.314307 1021 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:06.314415 1021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:06.314672 1021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:06.317628 1021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "83ad45536e66ec2260dd88d4fecbe32e"
server_key_iv: "6c2aead1edcad4bc5a0ce63ac06c07d1"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.318591 1021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "83ad45536e66ec2260dd88d4fecbe32e"
server_key_iv: "6c2aead1edcad4bc5a0ce63ac06c07d1"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.323958 1021 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 01:41:06.327462 1038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.328801 1021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:41:06.328989 1021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "83ad45536e66ec2260dd88d4fecbe32e"
server_key_iv: "6c2aead1edcad4bc5a0ce63ac06c07d1"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.329201 1021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:06.363173 1021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:06.367620 1021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:06.367959 1021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:06.369002 1021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:06.370543 1021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:06.370651 1021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.370826 1021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:06.370900 1021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.405287 1021 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:40253
I20260811 01:41:06.405349 1164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:40253 every 8 connection(s)
I20260811 01:41:06.406659 1021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:41:06.410192 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1021
I20260811 01:41:06.410421 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:41:06.410956 17936 external_mini_cluster.cc:1428] Setting key a9876f79444cc6084af7a2fed4e1c904
Aug 11 01:41:06 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412466, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:06.428764 1167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:06.409205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:53325 (local address 127.17.132.62:35321)
0811 01:41:06.409680 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:06.409686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:06.410879 (+ 1193us) server_negotiation.cc:407] Connection header received
0811 01:41:06.412985 (+ 2106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:06.412990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:06.413079 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:06.413194 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:06.414818 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.415542 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.417096 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.417551 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.417689 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:06.421955 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:06.421960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:06.421964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:06.421998 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:06.425325 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:06.426151 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:06.426159 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:06.426166 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:06.426337 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:06.426764 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:06.426772 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:06.426778 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:06.427158 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:06.427312 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:06.427988 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 01:41:06.428256 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":234,"threads_started":1}
I20260811 01:41:06.429374 1168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:06.409847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:53325)
0811 01:41:06.410686 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:06.410732 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:06.412704 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:06.413455 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:06.413464 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:06.414072 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:06.414638 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:06.414655 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.415710 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.415714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:06.416945 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:06.416957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.417826 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.417835 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:06.418078 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:06.418814 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:06.418842 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:06.421671 (+ 2829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:06.425476 (+ 3805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:06.425484 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:06.425498 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:06.426019 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:06.426452 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:06.426455 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:06.426457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:06.426638 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:06.427284 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:06.427290 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:06.427609 (+ 319us) client_negotiation.cc:769] Sending connection context
0811 01:41:06.427837 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 01:41:06.428242 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":369,"threads_started":1}
I20260811 01:41:06.430948 1165 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:06.431273 1165 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:06.431985 1165 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:06.433650 807 ts_manager.cc:194] Registered new tserver with Master: e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253)
I20260811 01:41:06.434621 807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:53325
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:41:06.477403 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:06.823210 1172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:06.823506 1172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:06.823697 1172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:06.830997 1172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:06.831103 1172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:06.831321 1172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:41:06.841430 1172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:06.842716 1172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:06.844003 1172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:06.858381 1181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:06.858484 1178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:06.858457 1179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:06.859139 1172 server_base.cc:1034] running on GCE node
I20260811 01:41:06.859711 1172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:06.860574 1172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:06.861828 1172 hybrid_clock.cc:648] HybridClock initialized: now 1786412466861743 us; error 27 us; skew 500 ppm
I20260811 01:41:06.862143 1172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:06 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412466, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:06.865357 1172 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:41:06.866992 1172 webserver.cc:460] Webserver started at http://127.17.132.3:34699/ using document root <none> and password file <none>
I20260811 01:41:06.867901 1172 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:06.868010 1172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:06.868268 1172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:06.869664 1015 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:06.871770 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "03142bcab1dc49459a0c993094c67d6d"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "0b3e9cdf75a7c151385c7a6f5e956019"
server_key_iv: "c7c75386e8bc577d4b82732186633cb2"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.872582 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "03142bcab1dc49459a0c993094c67d6d"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "0b3e9cdf75a7c151385c7a6f5e956019"
server_key_iv: "c7c75386e8bc577d4b82732186633cb2"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.878134 1172 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:41:06.881889 1188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.883376 1172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:41:06.883553 1172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "03142bcab1dc49459a0c993094c67d6d"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "0b3e9cdf75a7c151385c7a6f5e956019"
server_key_iv: "c7c75386e8bc577d4b82732186633cb2"
server_key_version: "encryptionkey@0"
I20260811 01:41:06.883754 1172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:06.913324 1172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:06.917987 1172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:06.918305 1172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:06.919287 1172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:06.920713 1172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:06.920787 1172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.920949 1172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:06.921008 1172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:06.956370 1172 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:35511
I20260811 01:41:06.956421 1313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:35511 every 8 connection(s)
I20260811 01:41:06.957638 1172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:41:06.967624 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1172
I20260811 01:41:06.967842 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:41:06.968300 17936 external_mini_cluster.cc:1428] Setting key 2114b6f55f8deb7b1276504574bf4a33
Aug 11 01:41:06 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412466, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:06.977741 1316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:06.960205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:38459 (local address 127.17.132.62:35321)
0811 01:41:06.960758 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:06.960762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:06.961701 (+ 939us) server_negotiation.cc:407] Connection header received
0811 01:41:06.963599 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:06.963605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:06.963711 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:06.963844 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:06.965355 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.966369 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.968391 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.968996 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.969138 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:06.972514 (+ 3376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:06.972519 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:06.972522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:06.972553 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:06.975094 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:06.975806 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:06.975810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:06.975812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:06.975926 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:06.976328 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:06.976332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:06.976333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:06.976585 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:06.976699 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:06.977309 (+ 610us) server_negotiation.cc:299] Negotiation successful
0811 01:41:06.977462 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":281,"threads_started":1}
I20260811 01:41:06.978708 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:06.960801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:38459)
0811 01:41:06.961533 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:06.961577 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:06.963332 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:06.964080 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:06.964089 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:06.964618 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:06.965168 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:06.965186 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.966603 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.966609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:06.968233 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:06.968248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.969224 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.969239 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:06.969434 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:06.970132 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:06.970155 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:06.972341 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:06.975223 (+ 2882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:06.975236 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:06.975248 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:06.975706 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:06.976046 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:06.976049 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:06.976052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:06.976224 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:06.976689 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:06.976694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:06.976997 (+ 303us) client_negotiation.cc:769] Sending connection context
0811 01:41:06.977208 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 01:41:06.977572 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":290,"threads_started":1}
I20260811 01:41:06.980165 1314 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:06.980443 1314 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:06.981118 1314 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:06.982767 807 ts_manager.cc:194] Registered new tserver with Master: 03142bcab1dc49459a0c993094c67d6d (127.17.132.3:35511)
I20260811 01:41:06.983881 807 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:38459
I20260811 01:41:06.984174 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:41:07.002732 1316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:06.989818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.17.132.62:35321)
0811 01:41:06.989978 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:06.989982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:06.990476 (+ 494us) server_negotiation.cc:407] Connection header received
0811 01:41:06.990672 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:06.990678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:06.990754 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:06.990855 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:06.992264 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.993000 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.994457 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:06.994866 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:06.995003 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:06.997322 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:06.997328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:06.997335 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:06.997372 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:06.999918 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.000618 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.000625 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.000629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.000758 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.001152 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.001157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.001161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.001504 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:07.001758 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.002167 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.002410 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:41:07.007072 807 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:41:07.014156 807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:41:07.039675 1328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.026874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34155 (local address 127.0.0.1:41850)
0811 01:41:07.027821 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:07.027884 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:07.028099 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:07.031309 (+ 3210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:07.031313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:07.031335 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:07.031926 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.031939 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.034192 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.034203 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.036718 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.036740 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.038472 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.038480 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.038691 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.038789 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 01:41:07.038925 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 01:41:07.039130 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":160,"thread_start_us":1625,"threads_started":1}
I20260811 01:41:07.039700 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.026951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40253 (local address 127.0.0.1:60176)
0811 01:41:07.028791 (+ 1840us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:07.028814 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:07.028953 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:07.031053 (+ 2100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:07.031061 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:07.031092 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:07.031697 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.031718 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.034142 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.034149 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.037034 (+ 2885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.037049 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.038812 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.038818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.038982 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.039013 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:41:07.039070 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:41:07.039178 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1691,"mutex_wait_us":140,"spinlock_wait_cycles":2432,"thread_start_us":648,"threads_started":1}
I20260811 01:41:07.040263 1329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.027178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.17.132.1:34155)
0811 01:41:07.030723 (+ 3545us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.030743 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.030770 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:41:07.030866 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.030872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.031087 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.032102 (+ 1015us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:07.032455 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.034027 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.036910 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.038252 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.038411 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.038688 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.038998 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.039185 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3383,"thread_start_us":3204,"threads_started":1}
I20260811 01:41:07.040534 1331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.030234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35511 (local address 127.0.0.1:56878)
0811 01:41:07.030994 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:07.031013 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:07.031135 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:07.032722 (+ 1587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:07.032727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:07.032764 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:07.033161 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.033208 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.035470 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.035476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.037758 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.037774 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.039578 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.039585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.039793 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.039827 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:41:07.039900 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 01:41:07.040046 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":88,"thread_start_us":1002,"threads_started":1}
I20260811 01:41:07.041636 1330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.027395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.17.132.2:40253)
0811 01:41:07.030340 (+ 2945us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.030350 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.030386 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:41:07.030509 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.030519 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.030794 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.031983 (+ 1189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:07.032247 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.033948 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.037217 (+ 3269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.038585 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.040804 (+ 2219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.041017 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.041109 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.041284 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2738,"thread_start_us":2587,"threads_started":1}
I20260811 01:41:07.041647 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.030945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56878 (local address 127.17.132.3:35511)
0811 01:41:07.031988 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.031995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.032028 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:41:07.032172 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.032180 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.032499 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.033458 (+ 959us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:07.033697 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.035303 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.037941 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.039308 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.040870 (+ 1562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.041067 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.041138 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.041295 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":1707,"threads_started":1}
I20260811 01:41:07.044358 945 tablet_service.cc:1467] Processing CreateTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f (DEFAULT_TABLE table=test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:07.044595 1096 tablet_service.cc:1467] Processing CreateTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f (DEFAULT_TABLE table=test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:07.045197 1241 tablet_service.cc:1467] Processing CreateTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f (DEFAULT_TABLE table=test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:07.046077 945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bf1145ff6d4f09859e9a2c4d83696f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:07.046092 1096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bf1145ff6d4f09859e9a2c4d83696f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:07.046569 1241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bf1145ff6d4f09859e9a2c4d83696f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:07.058674 1333 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Bootstrap starting.
I20260811 01:41:07.060801 1334 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Bootstrap starting.
I20260811 01:41:07.062695 1333 tablet_bootstrap.cc:654] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:07.063124 1335 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Bootstrap starting.
I20260811 01:41:07.064108 1333 log.cc:824] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:07.064939 1334 tablet_bootstrap.cc:654] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:07.066265 1334 log.cc:824] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:07.066516 1335 tablet_bootstrap.cc:654] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:07.067545 1333 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: No bootstrap required, opened a new log
I20260811 01:41:07.067850 1333 ts_tablet_manager.cc:1397] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260811 01:41:07.067840 1335 log.cc:824] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:07.069768 1334 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: No bootstrap required, opened a new log
I20260811 01:41:07.070129 1334 ts_tablet_manager.cc:1397] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 01:41:07.072579 1335 tablet_bootstrap.cc:492] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: No bootstrap required, opened a new log
I20260811 01:41:07.072860 1335 ts_tablet_manager.cc:1397] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 01:41:07.076062 1333 raft_consensus.cc:348] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.076496 1333 raft_consensus.cc:374] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:07.076625 1333 raft_consensus.cc:729] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03142bcab1dc49459a0c993094c67d6d, State: Initialized, Role: FOLLOWER
I20260811 01:41:07.077250 1333 consensus_queue.cc:260] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.078462 1314 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:07.079138 1333 ts_tablet_manager.cc:1428] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Time spent starting tablet: real 0.011s user 0.013s sys 0.000s
I20260811 01:41:07.080792 1334 raft_consensus.cc:348] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.081287 1334 raft_consensus.cc:374] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:07.081400 1334 raft_consensus.cc:729] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6ee4182cc224258ae63f3aa5003cfb0, State: Initialized, Role: FOLLOWER
I20260811 01:41:07.082067 1334 consensus_queue.cc:260] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.083277 1165 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:07.084111 1334 ts_tablet_manager.cc:1428] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260811 01:41:07.085170 1335 raft_consensus.cc:348] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.085561 1339 raft_consensus.cc:482] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:41:07.085619 1335 raft_consensus.cc:374] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:07.085711 1335 raft_consensus.cc:729] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e421ec2843af405492c939b3179e20ab, State: Initialized, Role: FOLLOWER
I20260811 01:41:07.085872 1339 raft_consensus.cc:504] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.086380 1335 consensus_queue.cc:260] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.087870 1339 leader_election.cc:288] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e421ec2843af405492c939b3179e20ab (127.17.132.1:34155), e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253)
I20260811 01:41:07.088323 1335 ts_tablet_manager.cc:1428] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260811 01:41:07.095752 1329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.088975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:43161 (local address 127.17.132.1:34155)
0811 01:41:07.089161 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.089166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.089181 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:41:07.089264 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.089268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.089529 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.089628 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:07.090327 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.091406 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.093714 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.094829 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.095028 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.095103 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.095371 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.095493 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:41:07.095785 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.088408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34155 (local address 127.17.132.3:43161)
0811 01:41:07.088777 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:07.088793 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:07.088887 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:07.089849 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:07.089861 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:07.089892 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:07.090158 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.090172 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.091533 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.091539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.093527 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.093542 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.095009 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.095015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.095202 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.095226 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:41:07.095346 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 01:41:07.095483 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":1}
I20260811 01:41:07.096298 1330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.089516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:43857 (local address 127.17.132.2:40253)
0811 01:41:07.089695 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.089701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.090408 (+ 707us) server_negotiation.cc:407] Connection header received
0811 01:41:07.090659 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.090664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.090739 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.090840 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:07.091340 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.092147 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.094562 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.095350 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.095546 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.095617 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.095962 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.096086 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:41:07.096714 965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bf1145ff6d4f09859e9a2c4d83696f" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421ec2843af405492c939b3179e20ab" is_pre_election: true
I20260811 01:41:07.096874 1343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.089336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40253 (local address 127.17.132.3:43857)
0811 01:41:07.090318 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:07.090335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:07.090498 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:07.090853 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:07.090858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:07.090882 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:07.091187 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.091195 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.092313 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.092320 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.094396 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:07.094411 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.095560 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.095567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:07.095746 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.095769 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:41:07.096487 (+ 718us) client_negotiation.cc:240] Negotiation successful
0811 01:41:07.096608 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"mutex_wait_us":26,"thread_start_us":557,"threads_started":1}
I20260811 01:41:07.097220 965 raft_consensus.cc:2454] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 0.
I20260811 01:41:07.097972 1192 leader_election.cc:302] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03142bcab1dc49459a0c993094c67d6d, e421ec2843af405492c939b3179e20ab; no voters:
I20260811 01:41:07.098057 1117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bf1145ff6d4f09859e9a2c4d83696f" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" is_pre_election: true
I20260811 01:41:07.098419 1339 raft_consensus.cc:2781] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:41:07.098573 1339 raft_consensus.cc:482] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:41:07.098536 1117 raft_consensus.cc:2454] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 0.
I20260811 01:41:07.098693 1339 raft_consensus.cc:3037] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:07.101004 1339 raft_consensus.cc:504] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.101593 1339 leader_election.cc:288] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 election: Requested vote from peers e421ec2843af405492c939b3179e20ab (127.17.132.1:34155), e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253)
I20260811 01:41:07.102073 1117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bf1145ff6d4f09859e9a2c4d83696f" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
I20260811 01:41:07.102186 965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bf1145ff6d4f09859e9a2c4d83696f" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421ec2843af405492c939b3179e20ab"
I20260811 01:41:07.102257 1117 raft_consensus.cc:3037] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:07.102417 965 raft_consensus.cc:3037] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:07.104502 965 raft_consensus.cc:2454] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 1.
I20260811 01:41:07.104513 1117 raft_consensus.cc:2454] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 1.
I20260811 01:41:07.104887 1192 leader_election.cc:302] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03142bcab1dc49459a0c993094c67d6d, e421ec2843af405492c939b3179e20ab; no voters:
I20260811 01:41:07.105226 1339 raft_consensus.cc:2781] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:07.105680 1339 raft_consensus.cc:686] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 1 LEADER]: Becoming Leader. State: Replica: 03142bcab1dc49459a0c993094c67d6d, State: Running, Role: LEADER
I20260811 01:41:07.106168 1339 consensus_queue.cc:237] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } }
I20260811 01:41:07.110884 806 catalog_manager.cc:5495] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 03142bcab1dc49459a0c993094c67d6d (127.17.132.3). New cstate: current_term: 1 leader_uuid: "03142bcab1dc49459a0c993094c67d6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } health_report { overall_health: HEALTHY } } }
I20260811 01:41:07.141681 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.136186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56880 (local address 127.17.132.3:35511)
0811 01:41:07.136407 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.136415 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.136438 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:41:07.136552 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.136556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.136632 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.136801 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:07.137180 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.137988 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.139449 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.139876 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.140017 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.140565 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:07.141068 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:41:07.141231 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.141326 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.141410 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:41:07.149981 965 raft_consensus.cc:1261] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Refusing update from remote peer 03142bcab1dc49459a0c993094c67d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:07.150009 1117 raft_consensus.cc:1261] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Refusing update from remote peer 03142bcab1dc49459a0c993094c67d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:07.151016 1344 consensus_queue.cc:1035] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:07.151379 1339 consensus_queue.cc:1035] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:41:07.158694 1166 tablet.cc:2369] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:41:07.162147 1347 mvcc.cc:205] Tried to move back new op lower bound from 7317145465435664384 to 7317145465270616064. Current Snapshot: MvccSnapshot[applied={T|T < 7317145465435664384}]
I20260811 01:41:07.164011 1349 mvcc.cc:205] Tried to move back new op lower bound from 7317145465435664384 to 7317145465270616064. Current Snapshot: MvccSnapshot[applied={T|T < 7317145465435664384}]
I20260811 01:41:07.168324 1348 mvcc.cc:205] Tried to move back new op lower bound from 7317145465435664384 to 7317145465270616064. Current Snapshot: MvccSnapshot[applied={T|T < 7317145465435664384}]
I20260811 01:41:07.176347 806 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:07.176659 806 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:07.180670 806 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Sending DeleteTablet for 3 replicas of tablet 22bf1145ff6d4f09859e9a2c4d83696f
I20260811 01:41:07.181883 945 tablet_service.cc:1514] Processing DeleteTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:07 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:41850
I20260811 01:41:07.181918 1241 tablet_service.cc:1514] Processing DeleteTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:07 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56878
I20260811 01:41:07.182699 1096 tablet_service.cc:1514] Processing DeleteTablet for tablet 22bf1145ff6d4f09859e9a2c4d83696f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:07 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:60176
I20260811 01:41:07.182847 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 873
I20260811 01:41:07.186448 1362 tablet_replica.cc:330] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: stopping tablet replica
I20260811 01:41:07.186942 1362 raft_consensus.cc:2229] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:41:07.187777 1362 raft_consensus.cc:2258] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:07.190400 1362 ts_tablet_manager.cc:1905] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:07.194607 1364 tablet_replica.cc:330] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: stopping tablet replica
I20260811 01:41:07.195233 1364 raft_consensus.cc:2229] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:07.195959 1364 raft_consensus.cc:2258] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:07.197527 1363 tablet_replica.cc:330] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: stopping tablet replica
I20260811 01:41:07.198102 1363 raft_consensus.cc:2229] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:07.198486 1362 ts_tablet_manager.cc:1918] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:07.198684 1362 log.cc:1196] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/22bf1145ff6d4f09859e9a2c4d83696f
I20260811 01:41:07.198663 1363 raft_consensus.cc:2258] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:07.199579 1362 ts_tablet_manager.cc:1939] T 22bf1145ff6d4f09859e9a2c4d83696f P 03142bcab1dc49459a0c993094c67d6d: Deleting consensus metadata
I20260811 01:41:07.201131 1363 ts_tablet_manager.cc:1905] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:07.201932 786 catalog_manager.cc:4841] TS 03142bcab1dc49459a0c993094c67d6d (127.17.132.3:35511): tablet 22bf1145ff6d4f09859e9a2c4d83696f (table test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]) successfully deleted
I20260811 01:41:07.203540 1364 ts_tablet_manager.cc:1905] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:07.209777 1363 ts_tablet_manager.cc:1918] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:07.210017 1363 log.cc:1196] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/22bf1145ff6d4f09859e9a2c4d83696f
I20260811 01:41:07.210624 1363 ts_tablet_manager.cc:1939] T 22bf1145ff6d4f09859e9a2c4d83696f P e421ec2843af405492c939b3179e20ab: Deleting consensus metadata
I20260811 01:41:07.210938 1364 ts_tablet_manager.cc:1918] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:07.211112 1364 log.cc:1196] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/22bf1145ff6d4f09859e9a2c4d83696f
Aug 11 01:41:07 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:41:07.211670 1364 ts_tablet_manager.cc:1939] T 22bf1145ff6d4f09859e9a2c4d83696f P e6ee4182cc224258ae63f3aa5003cfb0: Deleting consensus metadata
I20260811 01:41:07.212769 790 catalog_manager.cc:4841] TS e421ec2843af405492c939b3179e20ab (127.17.132.1:34155): tablet 22bf1145ff6d4f09859e9a2c4d83696f (table test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]) successfully deleted
I20260811 01:41:07.213420 787 catalog_manager.cc:4841] TS e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253): tablet 22bf1145ff6d4f09859e9a2c4d83696f (table test-table [id=f9506ae89e0b44ed8c46fda8d875aaa6]) successfully deleted
I20260811 01:41:07.219328 1329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.183815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.17.132.1:34155)
0811 01:41:07.184027 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.184036 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.199328 (+ 15292us) server_negotiation.cc:407] Connection header received
0811 01:41:07.199674 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.199680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.199802 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.199896 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:07.202429 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.203583 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.205770 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.206428 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.206534 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.213084 (+ 6550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:07.213099 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:07.213121 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:07.213170 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:07.216258 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.217199 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.217207 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.217209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.217343 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.217836 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.217843 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.217846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.218207 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:07.218436 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.218840 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.219016 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:41:07.220090 1010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:07.314509 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 873
I20260811 01:41:07.344313 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1021
Aug 11 01:41:07 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:41:07.374226 1330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.345999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60180 (local address 127.17.132.2:40253)
0811 01:41:07.346247 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.346256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.346281 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:41:07.346359 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.346368 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.346457 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.346572 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:07.348237 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.350373 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.352376 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.353109 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.353270 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.365573 (+ 12303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:07.365599 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:07.365623 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:07.365693 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:07.369777 (+ 4084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.370964 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.370977 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.370981 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.371171 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.371648 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.371655 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.371661 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.372282 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:07.372641 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.373313 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.373563 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 01:41:07.375593 1159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:07.509418 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1021
I20260811 01:41:07.530658 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1172
Aug 11 01:41:07 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:41:07.549015 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:07.531698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56888 (local address 127.17.132.3:35511)
0811 01:41:07.531916 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:07.531922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:07.531942 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:41:07.532112 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:07.532116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:07.532184 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:07.532323 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:07.533667 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.534611 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.535912 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:07.536430 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:07.536583 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:07.542088 (+ 5505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:07.542109 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:07.542127 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:07.542181 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:07.545585 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.546628 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.546643 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.546645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.546810 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:07.547258 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:07.547263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:07.547265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:07.547721 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:07.548060 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:07.548373 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 01:41:07.548609 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:41:07.549978 1307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:07.678812 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1172
I20260811 01:41:07.703240 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 769
I20260811 01:41:07.704383 838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:07.817040 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 769
I20260811 01:41:07.843029 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--webserver_interface=127.17.132.62
--webserver_port=42237
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:35321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:08.212146 1371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:08.212462 1371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:08.212554 1371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:08.220103 1371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:08.220281 1371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:08.220340 1371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:08.220402 1371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:08.220448 1371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:08.231045 1371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:35321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=42237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:08.232390 1371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:08.233700 1371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:08.263191 1379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:08.263252 1381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:08.263204 1378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:08.264106 1371 server_base.cc:1034] running on GCE node
I20260811 01:41:08.265142 1371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:08.267041 1371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:08.268301 1371 hybrid_clock.cc:648] HybridClock initialized: now 1786412468268218 us; error 62 us; skew 500 ppm
I20260811 01:41:08.268802 1371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:08 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412468, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:08.277004 1371 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:08.279026 1371 webserver.cc:460] Webserver started at http://127.17.132.62:42237/ using document root <none> and password file <none>
I20260811 01:41:08.279922 1371 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:08.280112 1371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:08.286954 1371 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:41:08.290146 1390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:08.291620 1371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:41:08.291822 1371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e6871af373fc45908e52fe47b2d8d7a3"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "29240ad3f8d8fb4e63df7e884b58ac22"
server_key_iv: "1cbf51f56b736f3b362a4c123500926d"
server_key_version: "encryptionkey@0"
I20260811 01:41:08.293036 1371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:08.313299 1371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:08.318571 1371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:08.318997 1371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:08.340583 1371 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:35321
I20260811 01:41:08.340651 1447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:35321 every 8 connection(s)
I20260811 01:41:08.342343 1371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:08.342981 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1371
I20260811 01:41:08.344046 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:34155
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=35129
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:41:08.350703 1450 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:41:08.354367 1450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap starting.
I20260811 01:41:08.384267 1450 log.cc:824] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:08.401541 1450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:41:08.402311 1450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap complete.
I20260811 01:41:08.417268 1450 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:08.418594 1450 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Initialized, Role: FOLLOWER
I20260811 01:41:08.419384 1450 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:08.419690 1450 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:08.419850 1450 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:08.420076 1450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:41:08.427263 1450 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:08.427994 1450 leader_election.cc:302] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6871af373fc45908e52fe47b2d8d7a3; no voters:
I20260811 01:41:08.428704 1450 leader_election.cc:288] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:41:08.428897 1454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:41:08.430397 1454 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 LEADER]: Becoming Leader. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Running, Role: LEADER
I20260811 01:41:08.431131 1450 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:08.431020 1454 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:08.434281 1455 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:08.434599 1455 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:08.433856 1456 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6871af373fc45908e52fe47b2d8d7a3. Latest consensus state: current_term: 2 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:08.435216 1456 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:08.439831 1461 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:08.448287 1461 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:08.449952 1461 catalog_manager.cc:1259] Loaded cluster ID: f76ea1b8c76a490497caa1ed0a64d7c7
I20260811 01:41:08.450073 1461 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:41:08.453500 1461 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 01:41:08.472229 1461 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 01:41:08.476008 1471 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:41:08.482863 1461 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:41:08.484807 1461 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Loaded TSK: 0
I20260811 01:41:08.486503 1461 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:41:08.756891 1452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:08.757296 1452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:08.757472 1452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:08.765226 1452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:08.765413 1452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:08.765604 1452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:41:08.775902 1452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:34155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=35129
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:08.777295 1452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:08.778801 1452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:08.793366 1480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:08.793293 1479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:08.793329 1482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:08.798400 1452 server_base.cc:1034] running on GCE node
I20260811 01:41:08.799183 1452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:08.800367 1452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:08.801606 1452 hybrid_clock.cc:648] HybridClock initialized: now 1786412468801551 us; error 48 us; skew 500 ppm
I20260811 01:41:08.801991 1452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:08 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412468, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:08.805490 1452 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:41:08.807288 1452 webserver.cc:460] Webserver started at http://127.17.132.1:35129/ using document root <none> and password file <none>
I20260811 01:41:08.808071 1452 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:08.808256 1452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:08.814294 1452 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:41:08.817224 1489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:08.818743 1452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:08.818938 1452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e421ec2843af405492c939b3179e20ab"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "c2a5c49fdd4e2c9a993fb71664bbae57"
server_key_iv: "e83bbfd4ce07829ab741b5510faf012f"
server_key_version: "encryptionkey@0"
I20260811 01:41:08.820035 1452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:08.838855 1452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:08.843168 1452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:08.843461 1452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:08.844539 1452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:08.845974 1452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:08.846101 1452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:08.846256 1452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:08.846347 1452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:08.881042 1452 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34155
I20260811 01:41:08.881165 1613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34155 every 8 connection(s)
I20260811 01:41:08.882642 1452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:41:08.891887 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1452
I20260811 01:41:08.892546 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:40253
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=36135
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:41:08 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412468, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:08.908520 1616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:08.885672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:59741 (local address 127.17.132.62:35321)
0811 01:41:08.886446 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:08.886468 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:08.887098 (+ 630us) server_negotiation.cc:407] Connection header received
0811 01:41:08.889262 (+ 2164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:08.889275 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:08.889598 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:08.889989 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:08.891412 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:08.892720 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:08.895386 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:08.896032 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:08.896170 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:08.900699 (+ 4529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:08.900708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:08.900724 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:08.900772 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:08.903744 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:08.904547 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:08.904554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:08.904560 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:08.904724 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:08.905195 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:08.905205 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:08.905206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:08.905677 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:08.905902 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:08.906754 (+ 852us) server_negotiation.cc:299] Negotiation successful
0811 01:41:08.907156 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":363,"threads_started":1}
I20260811 01:41:08.908519 1617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:08.885970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:59741)
0811 01:41:08.886825 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:08.886927 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:08.888767 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:08.890116 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:08.890123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:08.890649 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:08.891192 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:08.891209 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:08.892922 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:08.892930 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:08.895221 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:08.895250 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:08.896313 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:08.896323 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:08.896661 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:08.897439 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:08.897475 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:08.900391 (+ 2916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:08.903903 (+ 3512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:08.903913 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:08.903929 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:08.904387 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:08.904853 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:08.904858 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:08.904862 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:08.905066 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:08.905864 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:08.905872 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:08.906201 (+ 329us) client_negotiation.cc:769] Sending connection context
0811 01:41:08.906514 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 01:41:08.907099 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":347,"threads_started":1}
I20260811 01:41:08.911646 1614 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:08.912039 1614 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:08.913048 1614 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:08.915467 1409 ts_manager.cc:194] Registered new tserver with Master: e421ec2843af405492c939b3179e20ab (127.17.132.1:34155)
I20260811 01:41:08.916968 1409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:59741
W20260811 01:41:09.245819 1618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:09.246114 1618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:09.246299 1618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:09.253906 1618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:09.254041 1618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:09.254225 1618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:41:09.265511 1618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:40253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=36135
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:09.266893 1618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:09.268312 1618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:09.281981 1623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:09.281898 1624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:09.281950 1626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:09.282800 1618 server_base.cc:1034] running on GCE node
I20260811 01:41:09.283455 1618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:09.284459 1618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:09.285724 1618 hybrid_clock.cc:648] HybridClock initialized: now 1786412469285667 us; error 49 us; skew 500 ppm
I20260811 01:41:09.286144 1618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:09 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412469, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:09.289460 1618 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:41:09.291055 1618 webserver.cc:460] Webserver started at http://127.17.132.2:36135/ using document root <none> and password file <none>
I20260811 01:41:09.291743 1618 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:09.291864 1618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:09.297565 1618 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:41:09.300380 1635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:09.301713 1618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:41:09.301924 1618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "83ad45536e66ec2260dd88d4fecbe32e"
server_key_iv: "6c2aead1edcad4bc5a0ce63ac06c07d1"
server_key_version: "encryptionkey@0"
I20260811 01:41:09.302855 1618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:09.326371 1618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:09.330881 1618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:09.331120 1618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:09.332258 1618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:09.333711 1618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:09.333877 1618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 01:41:09.333971 1618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:09.334031 1618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:09.371325 1618 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:40253
I20260811 01:41:09.371415 1761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:40253 every 8 connection(s)
I20260811 01:41:09.372814 1618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:41:09.375415 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1618
I20260811 01:41:09.376212 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:35511
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=34699
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:41:09 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412469, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:09.393368 1616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.375638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:44935 (local address 127.17.132.62:35321)
0811 01:41:09.375827 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.375831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.377247 (+ 1416us) server_negotiation.cc:407] Connection header received
0811 01:41:09.379207 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.379213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.379333 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.379446 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:09.380914 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.381628 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.383186 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.383605 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.383739 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.387364 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:09.387369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:09.387372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:09.387405 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:09.390263 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.391013 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.391018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.391021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.391160 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.391612 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.391616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.391618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.391887 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:09.392071 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.392769 (+ 698us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.393002 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:41:09.394609 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.376298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:44935)
0811 01:41:09.377077 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:09.377123 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:09.378932 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:09.379689 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:09.379697 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:09.380202 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:09.380740 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.380756 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.381812 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.381821 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.383027 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.383039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.383839 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.383847 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.384075 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.384803 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:09.384825 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:09.387157 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:09.390408 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:09.390418 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:09.390435 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:09.390876 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:09.391277 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:09.391282 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:09.391286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:09.391478 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:09.392020 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:09.392030 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:09.392384 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 01:41:09.392651 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 01:41:09.393190 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":314,"threads_started":1}
I20260811 01:41:09.396349 1762 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:09.396698 1762 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:09.397648 1762 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:09.399422 1409 ts_manager.cc:194] Registered new tserver with Master: e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253)
I20260811 01:41:09.400250 1409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:44935
W20260811 01:41:09.732802 1766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:09.733177 1766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:09.733352 1766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:09.741142 1766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:09.741312 1766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:09.741501 1766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:41:09.751840 1766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:35511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=34699
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:09.753196 1766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:09.754498 1766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:09.768015 1772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:09.768157 1774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:09.768151 1771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:09.769183 1766 server_base.cc:1034] running on GCE node
I20260811 01:41:09.769996 1766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:09.771023 1766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:09.772269 1766 hybrid_clock.cc:648] HybridClock initialized: now 1786412469772223 us; error 36 us; skew 500 ppm
I20260811 01:41:09.772619 1766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:09 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412469, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:09.776086 1766 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:41:09.777673 1766 webserver.cc:460] Webserver started at http://127.17.132.3:34699/ using document root <none> and password file <none>
I20260811 01:41:09.778432 1766 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:09.778604 1766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:09.784057 1766 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 01:41:09.786998 1781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:09.788439 1766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:09.788623 1766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "03142bcab1dc49459a0c993094c67d6d"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "0b3e9cdf75a7c151385c7a6f5e956019"
server_key_iv: "c7c75386e8bc577d4b82732186633cb2"
server_key_version: "encryptionkey@0"
I20260811 01:41:09.789610 1766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:09.813144 1766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:09.817548 1766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:09.817972 1766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:09.819126 1766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:09.820652 1766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:09.820791 1766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:09.820930 1766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:09.821020 1766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:09.856581 1766 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:35511
I20260811 01:41:09.856643 1904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:35511 every 8 connection(s)
I20260811 01:41:09.858175 1766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:41:09.867188 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1766
Aug 11 01:41:09 dist-test-slave-0kls krb5kdc[755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412469, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:09.881227 1616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.861179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:54391 (local address 127.17.132.62:35321)
0811 01:41:09.861401 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.861409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.862738 (+ 1329us) server_negotiation.cc:407] Connection header received
0811 01:41:09.864594 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.864599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.864673 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.864770 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:09.866442 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.867201 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.869201 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.869687 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.869859 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.873436 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:09.873441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:09.873445 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:09.873476 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:09.877229 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.878119 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.878123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.878126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.878348 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.878916 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.878928 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.878931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.879272 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:09.879411 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.880573 (+ 1162us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.880817 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":77}
I20260811 01:41:09.883632 1907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.861751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:54391)
0811 01:41:09.862554 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:09.862602 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:09.864301 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:09.865006 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:09.865015 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:09.865573 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:09.866253 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.866271 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.867379 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.867385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.869038 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.869055 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.869954 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.869962 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.870194 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.870869 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:09.870898 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:09.873225 (+ 2327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:09.877399 (+ 4174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:09.877407 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:09.877421 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:09.877981 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:09.878483 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:09.878488 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:09.878492 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:09.878751 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:09.879505 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:09.879514 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:09.880046 (+ 532us) client_negotiation.cc:769] Sending connection context
0811 01:41:09.880402 (+ 356us) client_negotiation.cc:240] Negotiation successful
0811 01:41:09.882186 (+ 1784us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":287,"threads_started":1}
I20260811 01:41:09.884982 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.868253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34430 (local address 127.17.132.62:35321)
0811 01:41:09.869103 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.869107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.869122 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:41:09.869165 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.869169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.869222 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.869360 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:09.870987 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.871704 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.873423 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.873969 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.874122 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.878043 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:09.878052 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:09.878058 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:09.878096 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:09.881974 (+ 3878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.882716 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.882722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.882726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.882849 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:09.883248 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:09.883254 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:09.883257 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:09.883529 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:09.883954 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.884113 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.884357 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":606,"threads_started":1}
I20260811 01:41:09.885574 1905 heartbeater.cc:347] Connected to a master server at 127.17.132.62:35321
I20260811 01:41:09.885996 1905 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:09.887007 1905 heartbeater.cc:511] Master 127.17.132.62:35321 requested a full tablet report, sending...
I20260811 01:41:09.888777 1409 ts_manager.cc:194] Registered new tserver with Master: 03142bcab1dc49459a0c993094c67d6d (127.17.132.3:35511)
I20260811 01:41:09.889603 1409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:54391
I20260811 01:41:09.901072 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:41:09.908625 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.902301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.17.132.62:35321)
0811 01:41:09.902504 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.902509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.903086 (+ 577us) server_negotiation.cc:407] Connection header received
0811 01:41:09.903309 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.903313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.903460 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.903597 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:09.904109 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.904809 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.906428 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.906917 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.907015 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.907552 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:09.908129 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:41:09.908248 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.908351 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.908421 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:41:09.909611 1409 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:41:09.917104 1409 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:41:09.921087 1614 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:09.955920 1917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.930350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35511 (local address 127.0.0.1:56892)
0811 01:41:09.942662 (+ 12312us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:09.942726 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:09.942969 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:09.946653 (+ 3684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:09.946668 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:09.946723 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:09.947316 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.947333 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.950447 (+ 3114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.950456 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.953132 (+ 2676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.953145 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.954916 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.954922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.955131 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.955184 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 01:41:09.955318 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 01:41:09.955555 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12001,"thread_start_us":17158,"threads_started":1}
I20260811 01:41:09.956820 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.930662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56892 (local address 127.17.132.3:35511)
0811 01:41:09.945328 (+ 14666us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.945337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.945380 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:41:09.945488 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.945498 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.945910 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.946176 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:09.947913 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.950225 (+ 2312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.953300 (+ 3075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.954340 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.954492 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.954768 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.956395 (+ 1627us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.956539 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14461,"thread_start_us":14633,"threads_started":1}
I20260811 01:41:09.958669 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.930785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60190 (local address 127.17.132.2:40253)
0811 01:41:09.945222 (+ 14437us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.945238 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.946957 (+ 1719us) server_negotiation.cc:407] Connection header received
0811 01:41:09.947656 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.947670 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.948005 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.948240 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:09.949527 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.952079 (+ 2552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.955243 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.956951 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.957071 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.957298 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.958086 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.958310 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14161,"thread_start_us":14459,"threads_started":1}
I20260811 01:41:09.959498 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.930481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40253 (local address 127.0.0.1:60190)
0811 01:41:09.946817 (+ 16336us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:09.946837 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:09.947081 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:09.948652 (+ 1571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:09.948661 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:09.948703 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:09.949240 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.949257 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.952311 (+ 3054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.952317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.955003 (+ 2686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.955021 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.957525 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.957531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.957857 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.957896 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:41:09.958963 (+ 1067us) client_negotiation.cc:240] Negotiation successful
0811 01:41:09.959106 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16173,"mutex_wait_us":69,"thread_start_us":11085,"threads_started":1}
I20260811 01:41:09.960807 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.932788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34155 (local address 127.0.0.1:41880)
0811 01:41:09.951370 (+ 18582us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:09.951397 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:09.951520 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:09.952217 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:09.952222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:09.952256 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:09.952796 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.952809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.955344 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.955349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.957867 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:09.957883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.959989 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.959995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:09.960176 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.960209 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:41:09.960297 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 01:41:09.960432 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18413,"mutex_wait_us":3,"thread_start_us":18808,"threads_started":1}
I20260811 01:41:09.961009 1834 tablet_service.cc:1467] Processing CreateTablet for tablet 920f1593eae04276a31eab6d5771f996 (DEFAULT_TABLE table=test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:09.962781 1834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 920f1593eae04276a31eab6d5771f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:09.963038 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:09.932910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.17.132.1:34155)
0811 01:41:09.951581 (+ 18671us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:09.951592 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:09.951621 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:41:09.951733 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:09.951740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:09.951977 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:09.952211 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:09.952998 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.955172 (+ 2174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.958079 (+ 2907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:09.959465 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:09.959654 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:09.962458 (+ 2804us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:09.962534 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 01:41:09.962708 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18470,"thread_start_us":18199,"threads_started":1}
I20260811 01:41:09.963497 1686 tablet_service.cc:1467] Processing CreateTablet for tablet 920f1593eae04276a31eab6d5771f996 (DEFAULT_TABLE table=test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:09.964973 1686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 920f1593eae04276a31eab6d5771f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:09.967293 1543 tablet_service.cc:1467] Processing CreateTablet for tablet 920f1593eae04276a31eab6d5771f996 (DEFAULT_TABLE table=test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:09.968945 1543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 920f1593eae04276a31eab6d5771f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:09.976322 1923 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Bootstrap starting.
I20260811 01:41:09.979553 1923 tablet_bootstrap.cc:654] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:09.980645 1923 log.cc:824] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:09.982722 1925 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Bootstrap starting.
I20260811 01:41:09.986424 1926 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Bootstrap starting.
I20260811 01:41:09.987717 1925 tablet_bootstrap.cc:654] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:09.988955 1925 log.cc:824] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:09.990336 1923 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: No bootstrap required, opened a new log
I20260811 01:41:09.990517 1926 tablet_bootstrap.cc:654] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:09.990674 1923 ts_tablet_manager.cc:1397] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.008s
I20260811 01:41:09.991672 1926 log.cc:824] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:09.992336 1925 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: No bootstrap required, opened a new log
I20260811 01:41:09.992698 1925 ts_tablet_manager.cc:1397] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:41:09.995713 1926 tablet_bootstrap.cc:492] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: No bootstrap required, opened a new log
I20260811 01:41:09.996069 1926 ts_tablet_manager.cc:1397] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 01:41:10.001955 1923 raft_consensus.cc:348] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.002530 1923 raft_consensus.cc:374] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:10.002652 1923 raft_consensus.cc:729] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03142bcab1dc49459a0c993094c67d6d, State: Initialized, Role: FOLLOWER
I20260811 01:41:10.003475 1923 consensus_queue.cc:260] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.003572 1925 raft_consensus.cc:348] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.004015 1925 raft_consensus.cc:374] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:10.004164 1925 raft_consensus.cc:729] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6ee4182cc224258ae63f3aa5003cfb0, State: Initialized, Role: FOLLOWER
I20260811 01:41:10.005082 1925 consensus_queue.cc:260] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.005872 1926 raft_consensus.cc:348] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.006415 1926 raft_consensus.cc:374] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:10.006538 1926 raft_consensus.cc:729] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e421ec2843af405492c939b3179e20ab, State: Initialized, Role: FOLLOWER
I20260811 01:41:10.007350 1926 consensus_queue.cc:260] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.010073 1762 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:10.011379 1925 ts_tablet_manager.cc:1428] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Time spent starting tablet: real 0.019s user 0.013s sys 0.003s
I20260811 01:41:10.012449 1905 heartbeater.cc:503] Master 127.17.132.62:35321 was elected leader, sending a full tablet report...
I20260811 01:41:10.013096 1923 ts_tablet_manager.cc:1428] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Time spent starting tablet: real 0.022s user 0.013s sys 0.007s
I20260811 01:41:10.014931 1926 ts_tablet_manager.cc:1428] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Time spent starting tablet: real 0.019s user 0.010s sys 0.008s
I20260811 01:41:10.035725 1929 raft_consensus.cc:482] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:41:10.036026 1929 raft_consensus.cc:504] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.037657 1929 leader_election.cc:288] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253), e421ec2843af405492c939b3179e20ab (127.17.132.1:34155)
I20260811 01:41:10.043921 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.038367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:44985 (local address 127.17.132.1:34155)
0811 01:41:10.038597 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.038606 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.038634 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:41:10.038794 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.038801 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.038904 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.039038 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:10.039505 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.040332 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.042200 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.043010 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.043197 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.043273 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.043548 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.043671 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:41:10.043922 1907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.038050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34155 (local address 127.17.132.3:44985)
0811 01:41:10.038416 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:10.038440 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:10.038617 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:10.039076 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:10.039084 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:10.039125 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:10.039339 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:10.039349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.040471 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.040479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:10.042035 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:10.042048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.043178 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.043184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:10.043370 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.043394 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:41:10.043500 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:41:10.043643 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":1}
I20260811 01:41:10.045325 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.038189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:40253 (local address 127.17.132.3:33599)
0811 01:41:10.039328 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:10.039345 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:10.039511 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:10.039870 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:10.039875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:10.039900 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:10.040278 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:10.040287 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.041487 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.041493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:10.042996 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:10.043019 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.044519 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.044536 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:10.044716 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.044752 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:41:10.044851 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:41:10.044981 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":971,"thread_start_us":642,"threads_started":1}
I20260811 01:41:10.045085 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "920f1593eae04276a31eab6d5771f996" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421ec2843af405492c939b3179e20ab" is_pre_election: true
I20260811 01:41:10.045346 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.038397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:33599 (local address 127.17.132.2:40253)
0811 01:41:10.038656 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.038664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.039451 (+ 787us) server_negotiation.cc:407] Connection header received
0811 01:41:10.039662 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.039667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.039732 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.039856 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:10.040528 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.041318 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.043179 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.044304 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.044478 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.044580 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.044903 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.045050 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 01:41:10.045763 1565 raft_consensus.cc:2454] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 0.
I20260811 01:41:10.046696 1785 leader_election.cc:302] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03142bcab1dc49459a0c993094c67d6d, e421ec2843af405492c939b3179e20ab; no voters:
I20260811 01:41:10.046811 1713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "920f1593eae04276a31eab6d5771f996" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" is_pre_election: true
I20260811 01:41:10.047209 1929 raft_consensus.cc:2781] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:41:10.047365 1929 raft_consensus.cc:482] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:41:10.047379 1713 raft_consensus.cc:2454] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 0.
I20260811 01:41:10.047487 1929 raft_consensus.cc:3037] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:10.050210 1929 raft_consensus.cc:504] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.051004 1929 leader_election.cc:288] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 election: Requested vote from peers e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253), e421ec2843af405492c939b3179e20ab (127.17.132.1:34155)
I20260811 01:41:10.051716 1713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "920f1593eae04276a31eab6d5771f996" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
I20260811 01:41:10.051717 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "920f1593eae04276a31eab6d5771f996" candidate_uuid: "03142bcab1dc49459a0c993094c67d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e421ec2843af405492c939b3179e20ab"
I20260811 01:41:10.052001 1713 raft_consensus.cc:3037] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:10.052007 1565 raft_consensus.cc:3037] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:10.055953 1713 raft_consensus.cc:2454] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 1.
I20260811 01:41:10.055953 1565 raft_consensus.cc:2454] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03142bcab1dc49459a0c993094c67d6d in term 1.
I20260811 01:41:10.056633 1783 leader_election.cc:302] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03142bcab1dc49459a0c993094c67d6d, e6ee4182cc224258ae63f3aa5003cfb0; no voters:
I20260811 01:41:10.057077 1929 raft_consensus.cc:2781] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:10.057600 1929 raft_consensus.cc:686] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 1 LEADER]: Becoming Leader. State: Replica: 03142bcab1dc49459a0c993094c67d6d, State: Running, Role: LEADER
I20260811 01:41:10.058210 1929 consensus_queue.cc:237] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } }
I20260811 01:41:10.063925 1407 catalog_manager.cc:5495] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 03142bcab1dc49459a0c993094c67d6d (127.17.132.3). New cstate: current_term: 1 leader_uuid: "03142bcab1dc49459a0c993094c67d6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03142bcab1dc49459a0c993094c67d6d" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 } health_report { overall_health: UNKNOWN } } }
I20260811 01:41:10.081388 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.075890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56906 (local address 127.17.132.3:35511)
0811 01:41:10.076131 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.076136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.076157 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:41:10.076365 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.076369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.076449 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.076575 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:10.076993 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.077831 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.079282 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.079685 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.079795 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.080272 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:10.080782 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:41:10.080898 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.080993 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.081061 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 01:41:10.090231 1565 raft_consensus.cc:1261] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Refusing update from remote peer 03142bcab1dc49459a0c993094c67d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:10.090231 1713 raft_consensus.cc:1261] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Refusing update from remote peer 03142bcab1dc49459a0c993094c67d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:10.091385 1934 consensus_queue.cc:1035] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6ee4182cc224258ae63f3aa5003cfb0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:10.091778 1929 consensus_queue.cc:1035] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e421ec2843af405492c939b3179e20ab" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:10.111297 1937 mvcc.cc:205] Tried to move back new op lower bound from 7317145477478526976 to 7317145477363671040. Current Snapshot: MvccSnapshot[applied={T|T < 7317145477478526976 or (T in {7317145477478526976})}]
I20260811 01:41:10.125046 1409 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:10.125386 1409 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:10.129356 1409 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Sending DeleteTablet for 3 replicas of tablet 920f1593eae04276a31eab6d5771f996
I20260811 01:41:10.130738 1834 tablet_service.cc:1514] Processing DeleteTablet for tablet 920f1593eae04276a31eab6d5771f996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:10 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:56892
I20260811 01:41:10.130784 1543 tablet_service.cc:1514] Processing DeleteTablet for tablet 920f1593eae04276a31eab6d5771f996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:10 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:41880
I20260811 01:41:10.130784 1686 tablet_service.cc:1514] Processing DeleteTablet for tablet 920f1593eae04276a31eab6d5771f996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:10 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:60190
I20260811 01:41:10.133749 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1452
I20260811 01:41:10.143527 1950 tablet_replica.cc:330] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: stopping tablet replica
I20260811 01:41:10.144116 1950 raft_consensus.cc:2229] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:41:10.145026 1950 raft_consensus.cc:2258] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:10.146281 1948 tablet_replica.cc:330] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: stopping tablet replica
I20260811 01:41:10.146876 1948 raft_consensus.cc:2229] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:10.147321 1949 tablet_replica.cc:330] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: stopping tablet replica
I20260811 01:41:10.147465 1948 raft_consensus.cc:2258] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:10.148098 1949 raft_consensus.cc:2229] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:10.148599 1949 raft_consensus.cc:2258] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:10.150166 1950 ts_tablet_manager.cc:1905] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:10.150736 1949 ts_tablet_manager.cc:1905] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:10.150738 1948 ts_tablet_manager.cc:1905] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:10.158209 1950 ts_tablet_manager.cc:1918] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:10.158282 1949 ts_tablet_manager.cc:1918] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:10.158507 1950 log.cc:1196] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/920f1593eae04276a31eab6d5771f996
I20260811 01:41:10.158560 1949 log.cc:1196] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/920f1593eae04276a31eab6d5771f996
I20260811 01:41:10.159231 1950 ts_tablet_manager.cc:1939] T 920f1593eae04276a31eab6d5771f996 P 03142bcab1dc49459a0c993094c67d6d: Deleting consensus metadata
I20260811 01:41:10.159337 1949 ts_tablet_manager.cc:1939] T 920f1593eae04276a31eab6d5771f996 P e421ec2843af405492c939b3179e20ab: Deleting consensus metadata
I20260811 01:41:10.161388 1394 catalog_manager.cc:4841] TS e421ec2843af405492c939b3179e20ab (127.17.132.1:34155): tablet 920f1593eae04276a31eab6d5771f996 (table test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]) successfully deleted
I20260811 01:41:10.161859 1391 catalog_manager.cc:4841] TS 03142bcab1dc49459a0c993094c67d6d (127.17.132.3:35511): tablet 920f1593eae04276a31eab6d5771f996 (table test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]) successfully deleted
I20260811 01:41:10.162359 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.135885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41884 (local address 127.17.132.1:34155)
0811 01:41:10.136133 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.136142 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.136167 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:41:10.136244 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.136252 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.136353 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.136475 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:10.139314 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.140938 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.143614 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.144272 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.144402 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.153488 (+ 9086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:10.153504 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:10.153523 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:10.153577 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:10.157923 (+ 4346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.159138 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.159153 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.159158 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.159337 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.159886 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.159894 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.159900 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.160426 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:10.160765 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.161653 (+ 888us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.161948 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:41:10.163280 1609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:10.168438 1948 ts_tablet_manager.cc:1918] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:10.168658 1948 log.cc:1196] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/920f1593eae04276a31eab6d5771f996
I20260811 01:41:10.169159 1948 ts_tablet_manager.cc:1939] T 920f1593eae04276a31eab6d5771f996 P e6ee4182cc224258ae63f3aa5003cfb0: Deleting consensus metadata
I20260811 01:41:10.170943 1392 catalog_manager.cc:4841] TS e6ee4182cc224258ae63f3aa5003cfb0 (127.17.132.2:40253): tablet 920f1593eae04276a31eab6d5771f996 (table test-table [id=ec9b9a1c18d14ed4b7bcd1d9c5b332bf]) successfully deleted
I20260811 01:41:10.275204 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1452
I20260811 01:41:10.296613 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1618
I20260811 01:41:10.314210 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.297564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.17.132.2:40253)
0811 01:41:10.297833 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.297840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.297880 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:41:10.298015 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.298021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.298108 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.298229 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:10.299571 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.300755 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.302450 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.303086 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.303221 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.306296 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:10.306321 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:10.306363 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:10.306473 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:10.310787 (+ 4314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.311670 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.311682 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.311685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.311877 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.312288 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.312293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.312297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.312837 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:10.313148 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.313512 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.313773 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:41:10.315019 1756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:10.417951 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1618
I20260811 01:41:10.439414 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1766
I20260811 01:41:10.454615 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:10.440276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46860 (local address 127.17.132.3:35511)
0811 01:41:10.440471 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:10.440479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:10.440553 (+ 74us) server_negotiation.cc:407] Connection header received
0811 01:41:10.440797 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:10.440801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:10.440888 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:10.441038 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:10.442572 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.443421 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.444820 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:10.445305 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:10.445481 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:10.448288 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:10.448303 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:10.448319 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:10.448357 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:10.451550 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.452296 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.452312 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.452314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.452469 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:10.452872 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:10.452877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:10.452882 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:10.453264 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:10.453617 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:10.453974 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 01:41:10.454209 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:41:10.455416 1900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:10.584227 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1766
I20260811 01:41:10.610637 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 1371
I20260811 01:41:10.611909 1443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:10.730723 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 1371
I20260811 01:41:10.758458 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--webserver_interface=127.17.132.62
--webserver_port=42237
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:35321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:11.120688 1955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:11.121093 1955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:11.121263 1955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:11.128942 1955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:11.129133 1955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:11.129251 1955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:11.129361 1955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:11.129439 1955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:11.141050 1955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:35321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:35321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=42237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:11.142724 1955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:11.144131 1955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:11.156972 1962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:11.156962 1961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:11.157058 1964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:11.158072 1955 server_base.cc:1034] running on GCE node
I20260811 01:41:11.158993 1955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:11.160590 1955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:11.161902 1955 hybrid_clock.cc:648] HybridClock initialized: now 1786412471161848 us; error 55 us; skew 500 ppm
I20260811 01:41:11.162309 1955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:11 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412471, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:11.165690 1955 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:11.167408 1955 webserver.cc:460] Webserver started at http://127.17.132.62:42237/ using document root <none> and password file <none>
I20260811 01:41:11.168161 1955 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:11.168331 1955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:11.174115 1955 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:41:11.177050 1971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:11.178494 1955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:11.178687 1955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e6871af373fc45908e52fe47b2d8d7a3"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "29240ad3f8d8fb4e63df7e884b58ac22"
server_key_iv: "1cbf51f56b736f3b362a4c123500926d"
server_key_version: "encryptionkey@0"
I20260811 01:41:11.179685 1955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:11.197609 1955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:11.202369 1955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:11.202689 1955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:11.224108 1955 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:35321
I20260811 01:41:11.224154 2025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:35321 every 8 connection(s)
I20260811 01:41:11.225771 1955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:11.228713 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 1955
I20260811 01:41:11.229614 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:34155
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=35129
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:41:11.233325 2026 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:41:11.238505 2026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap starting.
I20260811 01:41:11.269886 2026 log.cc:824] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:11.292286 2026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:41:11.293064 2026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3: Bootstrap complete.
I20260811 01:41:11.307749 2026 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:11.308792 2026 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Initialized, Role: FOLLOWER
I20260811 01:41:11.309582 2026 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:11.309898 2026 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:11.310046 2026 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:11.310256 2026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:41:11.314486 2026 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:11.315045 2026 leader_election.cc:302] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6871af373fc45908e52fe47b2d8d7a3; no voters:
I20260811 01:41:11.315725 2026 leader_election.cc:288] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:41:11.315939 2030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:41:11.317114 2030 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [term 3 LEADER]: Becoming Leader. State: Replica: e6871af373fc45908e52fe47b2d8d7a3, State: Running, Role: LEADER
I20260811 01:41:11.317818 2030 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } }
I20260811 01:41:11.318048 2026 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:11.320744 2032 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6871af373fc45908e52fe47b2d8d7a3. Latest consensus state: current_term: 3 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:11.321236 2032 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:11.322000 2031 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e6871af373fc45908e52fe47b2d8d7a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6871af373fc45908e52fe47b2d8d7a3" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 35321 } } }
I20260811 01:41:11.322376 2031 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6871af373fc45908e52fe47b2d8d7a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:11.332607 2038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:11.346236 2038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:11.349053 2038 catalog_manager.cc:1259] Loaded cluster ID: f76ea1b8c76a490497caa1ed0a64d7c7
I20260811 01:41:11.349289 2038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 01:41:11.354190 2038 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbbd5fbb9ad google::LogMessage::Fail() at ??:0
@ 0x7fbbd5fbe88a google::LogMessage::SendToLog() at ??:0
@ 0x7fbbd5fbb4de google::LogMessage::Flush() at ??:0
@ 0x7fbbd5fbca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbbeb9ee512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fbbeb9eb976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbbeba73610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fbbeba73439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbbd8c07345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbbd8c0a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fbbd8c0a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbbd8be5eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbbdbebf6db start_thread at ??:0
@ 0x7fbbd4e5561f clone at ??:0
W20260811 01:41:11.652735 2028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:11.653038 2028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:11.653138 2028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:11.660701 2028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:11.660827 2028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:11.660945 2028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:41:11.671099 2028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:34155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=35129
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:11.672441 2028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:11.673840 2028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:11.688095 2072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:11.688031 2075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:11.688133 2071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:11.689388 2028 server_base.cc:1034] running on GCE node
I20260811 01:41:11.690101 2028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:11.691076 2028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:11.692322 2028 hybrid_clock.cc:648] HybridClock initialized: now 1786412471692272 us; error 59 us; skew 500 ppm
I20260811 01:41:11.692663 2028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:11 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412471, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:11.695947 2028 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:41:11.697468 2028 webserver.cc:460] Webserver started at http://127.17.132.1:35129/ using document root <none> and password file <none>
I20260811 01:41:11.698268 2028 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:11.698433 2028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:11.703969 2028 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:41:11.706892 2082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:11.708312 2028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:11.708496 2028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "e421ec2843af405492c939b3179e20ab"
format_stamp: "Formatted at 2026-08-11 01:41:05 on dist-test-slave-0kls"
server_key: "c2a5c49fdd4e2c9a993fb71664bbae57"
server_key_iv: "e83bbfd4ce07829ab741b5510faf012f"
server_key_version: "encryptionkey@0"
I20260811 01:41:11.709538 2028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:11.729684 2028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:11.734313 2028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:11.734616 2028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:11.735795 2028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:11.737278 2028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:11.737407 2028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:11.737552 2028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:11.737672 2028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:11.773325 2028 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34155
I20260811 01:41:11.773428 2207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34155 every 8 connection(s)
I20260811 01:41:11.774940 2028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:41:11.776270 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2028
I20260811 01:41:11.777081 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:40253
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=36135
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:41:11.781083 2210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:11.778515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:43475)
0811 01:41:11.779595 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:11.779906 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":365,"threads_started":1}
W20260811 01:41:11.781975 2208 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:35321 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:35321: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
I20260811 01:41:11.783022 2210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:11.782546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:42583)
0811 01:41:11.782756 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:11.782855 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 01:41:11.784046 2210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:11.783589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:43679)
0811 01:41:11.783770 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:11.783874 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:41:11.784348 2208 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:41:12.174615 2211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:12.175194 2211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:12.175508 2211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:12.189461 2211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:12.189646 2211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:12.190021 2211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:41:12.209127 2211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:40253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=36135
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:12.212198 2211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:12.215196 2211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:12.238874 2221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:12.238924 2217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:12.238960 2219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:12.241456 2211 server_base.cc:1034] running on GCE node
I20260811 01:41:12.242542 2211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:12.244134 2211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:12.245477 2211 hybrid_clock.cc:648] HybridClock initialized: now 1786412472245405 us; error 66 us; skew 500 ppm
I20260811 01:41:12.246102 2211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:12 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412472, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:12.251336 2211 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:41:12.254238 2211 webserver.cc:460] Webserver started at http://127.17.132.2:36135/ using document root <none> and password file <none>
I20260811 01:41:12.255581 2211 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:12.255849 2211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:12.266707 2211 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 01:41:12.273542 2229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.276152 2211 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 01:41:12.276464 2211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e6ee4182cc224258ae63f3aa5003cfb0"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "83ad45536e66ec2260dd88d4fecbe32e"
server_key_iv: "6c2aead1edcad4bc5a0ce63ac06c07d1"
server_key_version: "encryptionkey@0"
I20260811 01:41:12.278487 2211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:12.300204 2211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:12.308116 2211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:12.308588 2211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:12.310357 2211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:12.313036 2211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:12.313197 2211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.313396 2211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:12.313491 2211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.372645 2211 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:40253
I20260811 01:41:12.372732 2351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:40253 every 8 connection(s)
I20260811 01:41:12.375094 2211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:41:12.382728 2355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.379778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:42503)
0811 01:41:12.380874 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.381206 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":416,"threads_started":1}
I20260811 01:41:12.383841 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2211
W20260811 01:41:12.383944 2352 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:35321 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:35321: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
I20260811 01:41:12.384944 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:35511
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:35321
--webserver_port=34699
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:41:12.385417 2355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.384752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:36385)
0811 01:41:12.384986 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.385163 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:41:12.386904 2355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.386433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:39715)
0811 01:41:12.386611 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.386734 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 01:41:12.387212 2352 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:41:12.746417 2356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:12.746698 2356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:12.746869 2356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:12.754591 2356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:12.754700 2356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:12.754907 2356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:41:12.765050 2356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:35511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=34699
--tserver_master_addrs=127.17.132.62:35321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:12.766525 2356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:12.767855 2356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:12.785137 2363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:12.785113 2362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:12.785646 2365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:12.791477 2367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.785089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:52845)
0811 01:41:12.790943 (+ 5854us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.791107 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5666,"thread_start_us":5512,"threads_started":1}
I20260811 01:41:12.792093 2356 server_base.cc:1034] running on GCE node
I20260811 01:41:12.792836 2356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:12.793944 2356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:12.795176 2356 hybrid_clock.cc:648] HybridClock initialized: now 1786412472795133 us; error 44 us; skew 500 ppm
I20260811 01:41:12.795517 2356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:12 dist-test-slave-0kls krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412472, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:12.799053 2356 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:41:12.800710 2356 webserver.cc:460] Webserver started at http://127.17.132.3:34699/ using document root <none> and password file <none>
I20260811 01:41:12.801481 2356 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:12.801638 2356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:12.807550 2356 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 01:41:12.810616 2373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.812129 2356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:12.812335 2356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "03142bcab1dc49459a0c993094c67d6d"
format_stamp: "Formatted at 2026-08-11 01:41:06 on dist-test-slave-0kls"
server_key: "0b3e9cdf75a7c151385c7a6f5e956019"
server_key_iv: "c7c75386e8bc577d4b82732186633cb2"
server_key_version: "encryptionkey@0"
I20260811 01:41:12.813441 2356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:12.835106 2356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:12.839677 2356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:12.839993 2356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:12.841070 2356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:12.842653 2356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:12.842796 2356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.842926 2356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:12.843012 2356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:12.882453 2356 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:35511
I20260811 01:41:12.882525 2494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:35511 every 8 connection(s)
I20260811 01:41:12.884321 2356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:41:12.890442 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.888180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:51337)
0811 01:41:12.889097 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.889402 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":404,"threads_started":1}
W20260811 01:41:12.891235 2495 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:35321 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:35321: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
I20260811 01:41:12.891845 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2356
I20260811 01:41:12.892151 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.891771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:40225)
0811 01:41:12.891940 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.892033 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 01:41:12.893833 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:12.892732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:43101)
0811 01:41:12.893553 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:12.893654 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":705}
W20260811 01:41:12.894114 2495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:41:13.388782 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:13.387961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:42599)
0811 01:41:13.388439 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:13.388536 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":232,"threads_started":1}
I20260811 01:41:13.793560 2500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:13.792736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:56091)
0811 01:41:13.793287 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:13.793380 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":269,"threads_started":1}
I20260811 01:41:13.895399 2501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:13.894620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:52875)
0811 01:41:13.895052 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:13.895167 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":216,"threads_started":1}
I20260811 01:41:14.390704 2502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:14.389868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:39061)
0811 01:41:14.390448 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:14.390535 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":319,"threads_started":1}
I20260811 01:41:14.795563 2503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:14.794702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:36947)
0811 01:41:14.795237 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:14.795358 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":274,"threads_started":1}
I20260811 01:41:14.897190 2504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:14.896450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:58117)
0811 01:41:14.896930 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:14.897018 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":249,"threads_started":1}
I20260811 01:41:15.392520 2505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:15.391708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:33769)
0811 01:41:15.392239 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:15.392334 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":273,"threads_started":1}
I20260811 01:41:15.797402 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:15.796633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:55693)
0811 01:41:15.797113 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:15.797205 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260811 01:41:15.899154 2507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:15.898328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:60339)
0811 01:41:15.898842 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:15.898944 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":257,"threads_started":1}
I20260811 01:41:16.394490 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:16.393628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:38117)
0811 01:41:16.394238 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:16.394317 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":377,"threads_started":1}
I20260811 01:41:16.799468 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:16.798608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:58727)
0811 01:41:16.799195 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:16.799292 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":301,"threads_started":1}
I20260811 01:41:16.900740 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:16.900040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:58789)
0811 01:41:16.900470 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:16.900565 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":223,"threads_started":1}
I20260811 01:41:17.396312 2511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:17.395521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:42923)
0811 01:41:17.396046 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:17.396130 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":301,"threads_started":1}
I20260811 01:41:17.801254 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:17.800435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:45547)
0811 01:41:17.800924 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:17.801054 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":249,"threads_started":1}
I20260811 01:41:17.902562 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:17.901768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:55295)
0811 01:41:17.902305 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:17.902391 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":239,"threads_started":1}
I20260811 01:41:18.398070 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:18.397243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:40875)
0811 01:41:18.397734 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:18.397901 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":238,"threads_started":1}
I20260811 01:41:18.803443 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:18.802455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:43407)
0811 01:41:18.802999 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:18.803147 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":248,"threads_started":1}
I20260811 01:41:18.904652 2516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:18.903750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:33531)
0811 01:41:18.904321 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:18.904447 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":286,"threads_started":1}
I20260811 01:41:19.399998 2517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:19.399060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:36363)
0811 01:41:19.399639 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:19.399738 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":224,"threads_started":1}
I20260811 01:41:19.805145 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:19.804392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:54807)
0811 01:41:19.804882 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:19.804971 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":259,"threads_started":1}
I20260811 01:41:19.906746 2519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:19.905675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:35223)
0811 01:41:19.906398 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:19.906495 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":411,"threads_started":1}
I20260811 01:41:20.401928 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:20.400978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:35655)
0811 01:41:20.401482 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:20.401606 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":252,"threads_started":1}
I20260811 01:41:20.806936 2522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:20.806136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:45991)
0811 01:41:20.806666 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:20.806753 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":257,"threads_started":1}
I20260811 01:41:20.908437 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:20.907724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:35887)
0811 01:41:20.908189 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:20.908272 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":225,"threads_started":1}
I20260811 01:41:21.403697 2524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:21.402893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:47127)
0811 01:41:21.403423 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:21.403512 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":271,"threads_started":1}
I20260811 01:41:21.809134 2525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:21.808293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:37637)
0811 01:41:21.808867 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:21.808962 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":333,"threads_started":1}
I20260811 01:41:21.910305 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:21.909525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:57579)
0811 01:41:21.910026 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:21.910110 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":294,"threads_started":1}
I20260811 01:41:22.405421 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:22.404655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:47589)
0811 01:41:22.405145 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:22.405232 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":243,"threads_started":1}
I20260811 01:41:22.810967 2528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:22.810214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:40781)
0811 01:41:22.810679 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:22.810774 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":224,"threads_started":1}
I20260811 01:41:22.912036 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:22.911279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:37311)
0811 01:41:22.911730 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:22.911860 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":245,"threads_started":1}
I20260811 01:41:23.407474 2530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:23.406600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:48735)
0811 01:41:23.407199 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:23.407285 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":290,"threads_started":1}
I20260811 01:41:23.812888 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:23.812026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:48075)
0811 01:41:23.812543 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:23.812641 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":262,"threads_started":1}
I20260811 01:41:23.913983 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:23.913038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:45949)
0811 01:41:23.913639 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:23.913737 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":376,"threads_started":1}
I20260811 01:41:24.409441 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:24.408605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:35359)
0811 01:41:24.409163 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:24.409270 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":311,"threads_started":1}
I20260811 01:41:24.814843 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:24.814045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:46477)
0811 01:41:24.814554 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:24.814651 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":231,"threads_started":1}
I20260811 01:41:24.915652 2537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:24.914946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:56535)
0811 01:41:24.915384 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:24.915468 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":223,"threads_started":1}
I20260811 01:41:25.411404 2538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:25.410553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:35213)
0811 01:41:25.411088 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:25.411213 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":265,"threads_started":1}
I20260811 01:41:25.816651 2539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:25.815781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:41783)
0811 01:41:25.816258 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:25.816356 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":225,"threads_started":1}
I20260811 01:41:25.917666 2540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:25.916717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:33133)
0811 01:41:25.917338 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:25.917457 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":302,"threads_started":1}
I20260811 01:41:26.413476 2541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:26.412438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:53341)
0811 01:41:26.413149 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:26.413255 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":373,"threads_started":1}
I20260811 01:41:26.818810 2542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:26.818021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:42465)
0811 01:41:26.818509 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:26.818602 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":232,"threads_started":1}
I20260811 01:41:26.919179 2543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:26.918484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:38961)
0811 01:41:26.918901 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:26.918990 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":212,"threads_started":1}
I20260811 01:41:27.415632 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:27.414882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.2:57201)
0811 01:41:27.415365 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:27.415455 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":242,"threads_started":1}
I20260811 01:41:27.820581 2546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:27.819801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.1:36401)
0811 01:41:27.820309 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:27.820410 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":266,"threads_started":1}
I20260811 01:41:27.903709 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2028
I20260811 01:41:27.921260 2548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:27.920372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:35321 (local address 127.17.132.3:47771)
0811 01:41:27.920947 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:27.921040 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":313,"threads_started":1}
I20260811 01:41:27.926365 2547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:27.905398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44838 (local address 127.17.132.1:34155)
0811 01:41:27.906306 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:27.906329 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:27.906397 (+ 68us) server_negotiation.cc:407] Connection header received
0811 01:41:27.908582 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:27.908593 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:27.909062 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:27.909401 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:27.911136 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:27.912526 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:27.914083 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:27.914898 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:27.915054 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:27.918573 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:27.918583 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:27.918604 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:27.918654 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:27.922286 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:27.923242 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:27.923251 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:27.923259 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:27.923460 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:27.923897 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:27.923901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:27.923903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:27.924622 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:27.924910 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:27.925455 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 01:41:27.926037 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":431,"threads_started":1}
I20260811 01:41:27.928223 2202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:28.019235 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2028
I20260811 01:41:28.043313 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2211
I20260811 01:41:28.061761 2550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:28.044425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.17.132.2:40253)
0811 01:41:28.045174 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:28.045189 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:28.045228 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:41:28.046961 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:28.046972 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:28.047444 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:28.047739 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:28.049169 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:28.050598 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:28.051942 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:28.052634 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:28.052776 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:28.055667 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:28.055675 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:28.055691 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:28.055731 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:28.058785 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:28.059452 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:28.059458 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:28.059464 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:28.059626 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:28.059966 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:28.059969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:28.059971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:28.060474 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:28.060712 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:28.061107 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 01:41:28.061441 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":370,"threads_started":1}
I20260811 01:41:28.063257 2347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:28.149124 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2211
I20260811 01:41:28.171958 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2356
I20260811 01:41:28.190156 2552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:28.172943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.17.132.3:35511)
0811 01:41:28.173520 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:28.173535 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:28.173588 (+ 53us) server_negotiation.cc:407] Connection header received
0811 01:41:28.175345 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:28.175355 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:28.175783 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:28.176132 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:28.177590 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:28.178939 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:28.180202 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:28.180844 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:28.181034 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:28.183717 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:28.183725 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:28.183739 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:28.183777 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:28.186720 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:28.187422 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:28.187429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:28.187435 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:28.187602 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:28.188003 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:28.188009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:28.188012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:28.188557 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:28.188893 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:28.189371 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 01:41:28.189847 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":265,"threads_started":1}
I20260811 01:41:28.191540 2490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:28.277195 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2356
2026-08-11T01:41:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25090 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:41:28 dist-test-slave-0kls krb5kdc[2557](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:41:28 dist-test-slave-0kls krb5kdc[2557](info): set up 2 sockets
Aug 11 01:41:28 dist-test-slave-0kls krb5kdc[2557](info): commencing operation
krb5kdc: starting...
W20260811 01:41:29.468147 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:41:29 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:41:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:41:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:41:29.790539 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:30.158378 2572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:30.158700 2572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:30.158867 2572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:30.166474 2572 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:41:30.166585 2572 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:41:30.166672 2572 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:41:30.166785 2572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:30.166873 2572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:30.166996 2572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:30.167060 2572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:30.167142 2572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:30.177561 2572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:30.179003 2572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:30.180451 2572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:30.193127 2581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:30.193120 2578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:30.193812 2572 server_base.cc:1034] running on GCE node
W20260811 01:41:30.193993 2577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:30.195024 2572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:30.196568 2572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:30.197921 2572 hybrid_clock.cc:648] HybridClock initialized: now 1786412490197812 us; error 68 us; skew 500 ppm
I20260811 01:41:30.198305 2572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:30 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412490, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:30.201598 2572 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:30.203413 2572 webserver.cc:460] Webserver started at http://127.17.132.62:32997/ using document root <none> and password file <none>
I20260811 01:41:30.204150 2572 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:30.204299 2572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:30.204630 2572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:30.207818 2572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "ba4c1600d277438babf1f1413ccec43b"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "1df6250b68eab2560df99529dbfa9cc1"
server_key_iv: "93796f672148db3c93043e0d2a373f49"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.208637 2572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "ba4c1600d277438babf1f1413ccec43b"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "1df6250b68eab2560df99529dbfa9cc1"
server_key_iv: "93796f672148db3c93043e0d2a373f49"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.214301 2572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:41:30.217900 2588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:30.219245 2572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:41:30.219448 2572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "ba4c1600d277438babf1f1413ccec43b"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "1df6250b68eab2560df99529dbfa9cc1"
server_key_iv: "93796f672148db3c93043e0d2a373f49"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.219696 2572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:30.238965 2572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:30.243412 2572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:30.243711 2572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:30.264480 2572 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34739
I20260811 01:41:30.264501 2645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34739 every 8 connection(s)
I20260811 01:41:30.265971 2572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:30.269856 2646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:30.273120 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2572
I20260811 01:41:30.273372 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:41:30.274116 17936 external_mini_cluster.cc:1428] Setting key 37dc0f2142c0987c27d3bf03f1d0b6eb
I20260811 01:41:30.283289 2646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap starting.
I20260811 01:41:30.287503 2646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:30.289001 2646 log.cc:824] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:41:30 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:30.292783 2646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: No bootstrap required, opened a new log
I20260811 01:41:30.300073 2649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:30.276176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.17.132.62:34739)
0811 01:41:30.276968 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:30.276980 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:30.277023 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:41:30.278750 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:30.278775 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:30.279177 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:30.279521 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:30.281690 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.283093 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.285005 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.285699 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.285906 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:30.291763 (+ 5857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:30.291772 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:30.291788 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:30.291828 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:30.295307 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:30.296291 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:30.296298 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:30.296309 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:30.296489 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:30.296926 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:30.296929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:30.296931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:30.297552 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:30.297872 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:30.298360 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 01:41:30.298821 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":361,"threads_started":1}
I20260811 01:41:30.303143 2646 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:30.303725 2646 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:30.303869 2646 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Initialized, Role: FOLLOWER
I20260811 01:41:30.304509 2646 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:30.304793 2646 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:30.304961 2646 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:30.305158 2646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:30.307638 2646 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:30.308230 2646 leader_election.cc:302] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba4c1600d277438babf1f1413ccec43b; no voters:
I20260811 01:41:30.308904 2646 leader_election.cc:288] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:41:30.309087 2651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:30.310644 2651 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 LEADER]: Becoming Leader. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Running, Role: LEADER
I20260811 01:41:30.311367 2646 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:30.311241 2651 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:30.314642 2653 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba4c1600d277438babf1f1413ccec43b. Latest consensus state: current_term: 1 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:41:30.315213 2653 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:30.315716 2652 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:41:30.316020 2652 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:30.316748 2661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:30.322774 2661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:30.323742 2669 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:41:30.332871 2661 catalog_manager.cc:1347] Generated new cluster ID: 1aca75cc53654fee826b84844e36d914
I20260811 01:41:30.333022 2661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:41:30.368556 2661 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:41:30.370142 2661 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:41:30.378962 2661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Generated new TSK 0
I20260811 01:41:30.379848 2661 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:41:30.465694 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:30.856174 2673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:30.856509 2673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:30.856619 2673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:30.863751 2673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:30.863863 2673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:30.863979 2673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:41:30.873620 2673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:30.874908 2673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:30.876192 2673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:30.890046 2678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:30.890074 2682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:30.890113 2680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:30.890969 2673 server_base.cc:1034] running on GCE node
I20260811 01:41:30.891567 2673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:30.892511 2673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:30.893714 2673 hybrid_clock.cc:648] HybridClock initialized: now 1786412490893675 us; error 27 us; skew 500 ppm
I20260811 01:41:30.894097 2673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:30 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412490, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:30.897439 2673 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:41:30.899153 2673 webserver.cc:460] Webserver started at http://127.17.132.1:34345/ using document root <none> and password file <none>
I20260811 01:41:30.899919 2673 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:30.900075 2673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:30.900409 2673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:30.903620 2673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "efb9b7f451a2475ba367281b9aa7f66e"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "7d598aed2dfffb4c709f52d70b5c4e18"
server_key_iv: "dc0756fdfd8ab948c86aefb07ec71921"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.904462 2673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "efb9b7f451a2475ba367281b9aa7f66e"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "7d598aed2dfffb4c709f52d70b5c4e18"
server_key_iv: "dc0756fdfd8ab948c86aefb07ec71921"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.910039 2673 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:41:30.913654 2689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:30.915117 2673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:41:30.915300 2673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "efb9b7f451a2475ba367281b9aa7f66e"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "7d598aed2dfffb4c709f52d70b5c4e18"
server_key_iv: "dc0756fdfd8ab948c86aefb07ec71921"
server_key_version: "encryptionkey@0"
I20260811 01:41:30.915508 2673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:30.939556 2673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:30.944053 2673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:30.944375 2673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:30.945443 2673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:30.946985 2673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:30.947084 2673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:30.947240 2673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:30.947315 2673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:30.982812 2673 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34951
I20260811 01:41:30.982867 2815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34951 every 8 connection(s)
I20260811 01:41:30.984140 2673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:41:30.992810 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2673
I20260811 01:41:30.993041 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:41:30.993718 17936 external_mini_cluster.cc:1428] Setting key 5773a0c707d5d1665ab578fd21766432
Aug 11 01:41:30 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412490, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:31.006953 2818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:30.986858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:55283 (local address 127.17.132.62:34739)
0811 01:41:30.987340 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:30.987345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:30.988301 (+ 956us) server_negotiation.cc:407] Connection header received
0811 01:41:30.990280 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:30.990285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:30.990377 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:30.990500 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:30.991999 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.993086 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.994927 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.995328 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.995481 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:30.999655 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:30.999660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:30.999663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:30.999697 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:31.002722 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:31.003879 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:31.003883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:31.003886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:31.004051 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:31.004610 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:31.004613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:31.004615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:31.005001 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:31.005154 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:31.006242 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0811 01:41:31.006506 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260811 01:41:31.008314 2819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:30.987414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:55283)
0811 01:41:30.988120 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:30.988190 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:30.989991 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:30.990740 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:30.990748 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:30.991261 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:30.991823 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:30.991840 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.993266 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.993270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:30.994743 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:30.994757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:30.995615 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:30.995623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:30.995897 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:30.996582 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:30.996605 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:30.999425 (+ 2820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:31.002901 (+ 3476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:31.002916 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:31.002938 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:31.003700 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:31.004185 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:31.004193 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:31.004199 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:31.004473 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:31.005159 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:31.005170 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:31.005733 (+ 563us) client_negotiation.cc:769] Sending connection context
0811 01:41:31.006102 (+ 369us) client_negotiation.cc:240] Negotiation successful
0811 01:41:31.006776 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":267,"threads_started":1}
I20260811 01:41:31.010241 2816 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:31.010592 2816 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:31.011440 2816 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:31.013729 2607 ts_manager.cc:194] Registered new tserver with Master: efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1:34951)
I20260811 01:41:31.015446 2607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:55283
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:41:31.061010 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:31.409282 2823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:31.409585 2823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:31.409761 2823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:31.417539 2823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:31.417665 2823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:31.417889 2823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:41:31.428396 2823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:31.429836 2823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:31.431170 2823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:31.444698 2830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:31.444757 2831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:31.444796 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:31.445665 2823 server_base.cc:1034] running on GCE node
I20260811 01:41:31.446350 2823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:31.447301 2823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:31.448549 2823 hybrid_clock.cc:648] HybridClock initialized: now 1786412491448494 us; error 35 us; skew 500 ppm
I20260811 01:41:31.448946 2823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:31 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412491, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:31.452546 2823 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:41:31.454218 2823 webserver.cc:460] Webserver started at http://127.17.132.2:46185/ using document root <none> and password file <none>
I20260811 01:41:31.455006 2823 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:31.455178 2823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:31.455521 2823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:31.458703 2823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "cd5af835c0594c82aed25dc41143440f"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "d6cfc381bbced5af5969c37b8ec3fcf7"
server_key_iv: "621cce981c2e284d6cf95fc363d4df48"
server_key_version: "encryptionkey@0"
I20260811 01:41:31.459585 2823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "cd5af835c0594c82aed25dc41143440f"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "d6cfc381bbced5af5969c37b8ec3fcf7"
server_key_iv: "621cce981c2e284d6cf95fc363d4df48"
server_key_version: "encryptionkey@0"
I20260811 01:41:31.465104 2823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:41:31.468731 2840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:31.470278 2823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:41:31.470472 2823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "cd5af835c0594c82aed25dc41143440f"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "d6cfc381bbced5af5969c37b8ec3fcf7"
server_key_iv: "621cce981c2e284d6cf95fc363d4df48"
server_key_version: "encryptionkey@0"
I20260811 01:41:31.470691 2823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:31.484915 2823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:31.488806 2823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:31.489123 2823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:31.490149 2823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:31.491490 2823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:31.491602 2823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:31.491758 2823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:31.491847 2823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:31.527047 2823 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:44113
I20260811 01:41:31.527112 2965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:44113 every 8 connection(s)
I20260811 01:41:31.528358 2823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:41:31.531047 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2823
I20260811 01:41:31.531306 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:41:31.532049 17936 external_mini_cluster.cc:1428] Setting key fce5e9ab91e4ff857343e951a4e9d6dd
Aug 11 01:41:31 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412491, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:31.550828 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:31.530985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:56155 (local address 127.17.132.62:34739)
0811 01:41:31.534214 (+ 3229us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:31.534228 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:31.534249 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:41:31.534851 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:31.534857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:31.534936 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:31.535057 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:31.536517 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:31.537695 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:31.539282 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:31.540088 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:31.540231 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:31.543946 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:31.543955 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:31.543963 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:31.544010 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:31.547293 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:31.548310 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:31.548314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:31.548316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:31.548460 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:31.549012 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:31.549016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:31.549018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:31.549298 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:31.549432 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:31.550358 (+ 926us) server_negotiation.cc:299] Negotiation successful
0811 01:41:31.550535 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3096,"thread_start_us":2978,"threads_started":1}
I20260811 01:41:31.552470 2970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:31.531511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:56155)
0811 01:41:31.532356 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:31.532405 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:31.534591 (+ 2186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:31.535266 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:31.535274 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:31.535791 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:31.536334 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:31.536352 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:31.537909 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:31.537914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:31.539132 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:31.539144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:31.540294 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:31.540299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:31.540496 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:31.541199 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:31.541221 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:31.543699 (+ 2478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:31.547457 (+ 3758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:31.547469 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:31.547491 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:31.548189 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:31.548581 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:31.548589 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:31.548595 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:31.548859 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:31.549446 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:31.549457 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:31.549932 (+ 475us) client_negotiation.cc:769] Sending connection context
0811 01:41:31.550256 (+ 324us) client_negotiation.cc:240] Negotiation successful
0811 01:41:31.550898 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":362,"threads_started":1}
I20260811 01:41:31.554239 2967 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:31.554589 2967 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:31.555370 2967 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:31.556972 2607 ts_manager.cc:194] Registered new tserver with Master: cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:31.557866 2607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:56155
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:41:31.602290 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:31.952620 2973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:31.952961 2973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:31.953140 2973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:31.960564 2973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:31.960733 2973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:31.960923 2973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:41:31.971347 2973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:31.972744 2973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:31.974268 2973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:31.990193 2979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:31.990325 2981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:31.990142 2978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:31.991031 2973 server_base.cc:1034] running on GCE node
I20260811 01:41:31.991640 2973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:31.992552 2973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:31.993760 2973 hybrid_clock.cc:648] HybridClock initialized: now 1786412491993718 us; error 29 us; skew 500 ppm
I20260811 01:41:31.994117 2973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:31 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412491, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:31.997396 2973 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:41:31.998944 2973 webserver.cc:460] Webserver started at http://127.17.132.3:33719/ using document root <none> and password file <none>
I20260811 01:41:31.999683 2973 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:31.999840 2973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:32.000180 2973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:41:32.004313 2973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "95144307ff1c4878a8009a3d63c7f865"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "61c1dab7beccf15237c53f8bc8a649b6"
server_key_iv: "548a014ec6796fe5f4c8514bb7f89747"
server_key_version: "encryptionkey@0"
I20260811 01:41:32.005559 2973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "95144307ff1c4878a8009a3d63c7f865"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "61c1dab7beccf15237c53f8bc8a649b6"
server_key_iv: "548a014ec6796fe5f4c8514bb7f89747"
server_key_version: "encryptionkey@0"
I20260811 01:41:32.015057 2973 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.004s
I20260811 01:41:32.018760 2816 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:32.019775 2988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:32.021413 2973 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:41:32.021620 2973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "95144307ff1c4878a8009a3d63c7f865"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "61c1dab7beccf15237c53f8bc8a649b6"
server_key_iv: "548a014ec6796fe5f4c8514bb7f89747"
server_key_version: "encryptionkey@0"
I20260811 01:41:32.021889 2973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:32.042191 2973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:32.046710 2973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:32.047072 2973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:32.048209 2973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:32.049821 2973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:32.049906 2973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 01:41:32.050062 2973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:32.050113 2973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:32.085270 2973 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:34345
I20260811 01:41:32.085321 3109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:34345 every 8 connection(s)
I20260811 01:41:32.086658 2973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:41:32.094801 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 2973
I20260811 01:41:32.095032 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:41:32.095544 17936 external_mini_cluster.cc:1428] Setting key 4bebf09d94e6db781def15a1e28c639c
Aug 11 01:41:32 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412491, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:32.108268 3112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.089410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:49649 (local address 127.17.132.62:34739)
0811 01:41:32.089935 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.089940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.090942 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 01:41:32.092868 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.092874 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.092972 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.093100 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:32.094799 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.095780 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.098024 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.098463 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.098627 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.102408 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:32.102413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:32.102417 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:32.102451 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:32.104977 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.105810 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.105818 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.105824 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.105970 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.106448 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.106453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.106456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.106728 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:32.106907 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.107617 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.107855 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":231,"threads_started":1}
I20260811 01:41:32.109269 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.090027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:49649)
0811 01:41:32.090769 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.090814 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.092569 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.093359 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.093368 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.093989 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:32.094607 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.094626 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.095954 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.095959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.097877 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.097894 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.098786 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.098795 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.099048 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.099713 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:32.099760 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:32.102154 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:32.105144 (+ 2990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:32.105155 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:32.105175 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:32.105631 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:32.106094 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:32.106100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:32.106103 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:32.106317 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:32.106869 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:32.106877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:32.107248 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.107527 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.108110 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":279,"threads_started":1}
I20260811 01:41:32.110977 3110 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:32.111320 3110 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:32.112136 3110 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:32.113731 2606 ts_manager.cc:194] Registered new tserver with Master: 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345)
I20260811 01:41:32.114804 2606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:49649
I20260811 01:41:32.124358 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:41:32.142796 3112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.129213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39840 (local address 127.17.132.62:34739)
0811 01:41:32.129394 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.129399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.129962 (+ 563us) server_negotiation.cc:407] Connection header received
0811 01:41:32.130116 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.130119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.130186 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.130272 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:32.131872 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.132684 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.134194 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.134629 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.134741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.137144 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:32.137148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:32.137152 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:32.137185 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:32.139885 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.140606 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.140611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.140613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.140757 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.141255 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.141259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.141261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.141629 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:32.141881 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.142362 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.142545 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:41:32.147310 2606 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:41:32.154647 2606 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:41:32.185622 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.168691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.17.132.3:34345)
0811 01:41:32.170913 (+ 2222us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.170924 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.170962 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:41:32.171077 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.171087 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.172506 (+ 1419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.173829 (+ 1323us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:32.174208 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.177933 (+ 3725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.181625 (+ 3692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.184136 (+ 2511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.184271 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.184518 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.185043 (+ 525us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.185230 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2062,"thread_start_us":1922,"threads_started":1}
I20260811 01:41:32.185876 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.168309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:34345 (local address 127.0.0.1:47134)
0811 01:41:32.169919 (+ 1610us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.169969 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.170209 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.172860 (+ 2651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.172872 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.172916 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:32.173494 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.173512 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.178160 (+ 4648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.178169 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.181175 (+ 3006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.181192 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.184363 (+ 3171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.184372 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.184731 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.184803 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.184953 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.185311 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1265,"mutex_wait_us":140,"thread_start_us":2744,"threads_started":1}
I20260811 01:41:32.189639 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.169648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40342 (local address 127.17.132.2:44113)
0811 01:41:32.181054 (+ 11406us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.181063 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.181097 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:41:32.181204 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.181212 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.181518 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.182654 (+ 1136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:32.182891 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.184431 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.186891 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.188380 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.188527 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.188722 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.189137 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.189303 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11237,"thread_start_us":11112,"threads_started":1}
I20260811 01:41:32.189659 3124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.169002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44113 (local address 127.0.0.1:40342)
0811 01:41:32.171339 (+ 2337us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.171360 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.171477 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.181798 (+ 10321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.181803 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.181835 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:32.182412 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.182427 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.184602 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.184608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.186714 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.186727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.188616 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.188623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.188862 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.188927 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.189030 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.189192 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2219,"mutex_wait_us":76,"thread_start_us":891,"threads_started":1}
I20260811 01:41:32.190444 3041 tablet_service.cc:1467] Processing CreateTablet for tablet 5a800d85e0594db490a1817660f8b899 (DEFAULT_TABLE table=test-table [id=607270b484324095ae2604105a762a1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:32.192014 3041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a800d85e0594db490a1817660f8b899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:32.193413 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.171790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:47950)
0811 01:41:32.184292 (+ 12502us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.184313 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.184458 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.185567 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.185571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.185601 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:32.186999 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.187012 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.188791 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.188796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.190625 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.190639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.192552 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.192559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.192734 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.192768 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.192857 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.192988 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12319,"mutex_wait_us":1,"thread_start_us":12772,"threads_started":1}
I20260811 01:41:32.193702 2895 tablet_service.cc:1467] Processing CreateTablet for tablet 5a800d85e0594db490a1817660f8b899 (DEFAULT_TABLE table=test-table [id=607270b484324095ae2604105a762a1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:32.194702 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.171926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47950 (local address 127.17.132.1:34951)
0811 01:41:32.180856 (+ 8930us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.180866 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.184618 (+ 3752us) server_negotiation.cc:407] Connection header received
0811 01:41:32.184743 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.184751 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.185057 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.185299 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:32.187204 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.188620 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.190789 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.192288 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.192441 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.192688 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.194186 (+ 1498us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.194355 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8677,"thread_start_us":8458,"threads_started":1}
I20260811 01:41:32.195174 2895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a800d85e0594db490a1817660f8b899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:32.198441 2741 tablet_service.cc:1467] Processing CreateTablet for tablet 5a800d85e0594db490a1817660f8b899 (DEFAULT_TABLE table=test-table [id=607270b484324095ae2604105a762a1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:32.200085 2741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a800d85e0594db490a1817660f8b899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:32.204977 3131 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Bootstrap starting.
I20260811 01:41:32.208254 3131 tablet_bootstrap.cc:654] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:32.209363 3131 log.cc:824] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:32.211917 3132 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Bootstrap starting.
I20260811 01:41:32.213111 3131 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: No bootstrap required, opened a new log
I20260811 01:41:32.213429 3131 ts_tablet_manager.cc:1397] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:41:32.215852 3132 tablet_bootstrap.cc:654] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:32.217031 3134 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Bootstrap starting.
I20260811 01:41:32.217111 3132 log.cc:824] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:32.220350 3134 tablet_bootstrap.cc:654] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:32.221690 3134 log.cc:824] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:32.225042 3132 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: No bootstrap required, opened a new log
I20260811 01:41:32.225162 3134 tablet_bootstrap.cc:492] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: No bootstrap required, opened a new log
I20260811 01:41:32.225349 3132 ts_tablet_manager.cc:1397] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260811 01:41:32.225441 3134 ts_tablet_manager.cc:1397] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 01:41:32.225852 3131 raft_consensus.cc:348] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.226411 3131 raft_consensus.cc:374] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:32.226526 3131 raft_consensus.cc:729] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95144307ff1c4878a8009a3d63c7f865, State: Initialized, Role: FOLLOWER
I20260811 01:41:32.227300 3131 consensus_queue.cc:260] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.228497 3110 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:32.229107 3131 ts_tablet_manager.cc:1428] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Time spent starting tablet: real 0.016s user 0.007s sys 0.008s
I20260811 01:41:32.234874 3132 raft_consensus.cc:348] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.235414 3132 raft_consensus.cc:374] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:32.235543 3132 raft_consensus.cc:729] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5af835c0594c82aed25dc41143440f, State: Initialized, Role: FOLLOWER
I20260811 01:41:32.235710 3134 raft_consensus.cc:348] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.236058 3134 raft_consensus.cc:374] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:32.236155 3134 raft_consensus.cc:729] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb9b7f451a2475ba367281b9aa7f66e, State: Initialized, Role: FOLLOWER
I20260811 01:41:32.236204 3132 consensus_queue.cc:260] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.236727 3134 consensus_queue.cc:260] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.237423 2967 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:32.238168 3132 ts_tablet_manager.cc:1428] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Time spent starting tablet: real 0.013s user 0.012s sys 0.002s
I20260811 01:41:32.238438 3134 ts_tablet_manager.cc:1428] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260811 01:41:32.280431 2968 tablet.cc:2369] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:41:32.288221 3139 raft_consensus.cc:482] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:41:32.288652 3139 raft_consensus.cc:504] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.290524 3139 leader_election.cc:288] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345), cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:32.298463 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.291196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:34311 (local address 127.17.132.3:34345)
0811 01:41:32.291438 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.291444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.292382 (+ 938us) server_negotiation.cc:407] Connection header received
0811 01:41:32.292593 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.292599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.292671 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.292782 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:32.293478 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.294502 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.296627 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.297398 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.297554 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.297648 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.298026 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.298182 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:41:32.298473 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.291197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:52799 (local address 127.17.132.2:44113)
0811 01:41:32.291436 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.291444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.292313 (+ 869us) server_negotiation.cc:407] Connection header received
0811 01:41:32.292538 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.292548 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.292610 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.292714 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:32.293384 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.294256 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.296566 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.297431 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.297637 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.297711 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.298092 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.298221 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 01:41:32.298849 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.291284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:34345 (local address 127.17.132.1:34311)
0811 01:41:32.292293 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.292308 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.292435 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.292797 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.292801 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.292830 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:32.293298 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.293309 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.294663 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.294675 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.296434 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.296447 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.297623 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.297636 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.297866 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.297892 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.297974 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.298116 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":42,"thread_start_us":565,"threads_started":1}
I20260811 01:41:32.298890 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.291265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44113 (local address 127.17.132.1:52799)
0811 01:41:32.292185 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:32.292201 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:32.292397 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:32.292733 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:32.292738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:32.292763 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:32.293215 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.293232 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.294443 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.294457 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.296396 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:32.296412 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.297711 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.297718 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:32.297911 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.297935 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:41:32.298050 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 01:41:32.298177 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":39,"thread_start_us":546,"threads_started":1}
I20260811 01:41:32.299978 3062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a800d85e0594db490a1817660f8b899" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95144307ff1c4878a8009a3d63c7f865" is_pre_election: true
I20260811 01:41:32.300029 2916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a800d85e0594db490a1817660f8b899" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd5af835c0594c82aed25dc41143440f" is_pre_election: true
I20260811 01:41:32.300520 2916 raft_consensus.cc:2454] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 0.
I20260811 01:41:32.300521 3062 raft_consensus.cc:2454] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 0.
I20260811 01:41:32.301201 2693 leader_election.cc:302] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95144307ff1c4878a8009a3d63c7f865, efb9b7f451a2475ba367281b9aa7f66e; no voters:
I20260811 01:41:32.301608 3139 raft_consensus.cc:2781] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:41:32.301827 3139 raft_consensus.cc:482] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:41:32.301947 3139 raft_consensus.cc:3037] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:32.304229 3139 raft_consensus.cc:504] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.304896 3139 leader_election.cc:288] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 election: Requested vote from peers 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345), cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:32.305434 3062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a800d85e0594db490a1817660f8b899" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95144307ff1c4878a8009a3d63c7f865"
I20260811 01:41:32.305516 2916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a800d85e0594db490a1817660f8b899" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd5af835c0594c82aed25dc41143440f"
I20260811 01:41:32.305683 3062 raft_consensus.cc:3037] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:32.305747 2916 raft_consensus.cc:3037] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:32.309151 2916 raft_consensus.cc:2454] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 1.
I20260811 01:41:32.309170 3062 raft_consensus.cc:2454] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 1.
I20260811 01:41:32.309670 2692 leader_election.cc:302] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd5af835c0594c82aed25dc41143440f, efb9b7f451a2475ba367281b9aa7f66e; no voters:
I20260811 01:41:32.310055 3139 raft_consensus.cc:2781] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:32.310724 3139 raft_consensus.cc:686] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 1 LEADER]: Becoming Leader. State: Replica: efb9b7f451a2475ba367281b9aa7f66e, State: Running, Role: LEADER
I20260811 01:41:32.311440 3139 consensus_queue.cc:237] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:32.316386 2606 catalog_manager.cc:5495] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e reported cstate change: term changed from 0 to 1, leader changed from <none> to efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1). New cstate: current_term: 1 leader_uuid: "efb9b7f451a2475ba367281b9aa7f66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } health_report { overall_health: UNKNOWN } } }
W20260811 01:41:32.338378 3111 tablet.cc:2369] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:41:32.338887 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.333045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47962 (local address 127.17.132.1:34951)
0811 01:41:32.333285 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.333293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.333315 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:41:32.333590 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.333594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.333675 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.333883 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:32.334295 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.335054 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.336544 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.336982 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.337121 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.337668 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:32.338259 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:41:32.338431 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.338515 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.338602 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:41:32.347486 2916 raft_consensus.cc:1261] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Refusing update from remote peer efb9b7f451a2475ba367281b9aa7f66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:32.347486 3062 raft_consensus.cc:1261] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Refusing update from remote peer efb9b7f451a2475ba367281b9aa7f66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:32.348634 3142 consensus_queue.cc:1035] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:32.349092 3139 consensus_queue.cc:1035] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:32.361230 3145 mvcc.cc:205] Tried to move back new op lower bound from 7317145568643362816 to 7317145568511934464. Current Snapshot: MvccSnapshot[applied={T|T < 7317145568643362816}]
I20260811 01:41:32.375545 2606 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:32.375860 2606 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:32.380192 2606 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Sending DeleteTablet for 3 replicas of tablet 5a800d85e0594db490a1817660f8b899
I20260811 01:41:32.381515 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2673
I20260811 01:41:32.381486 2741 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a800d85e0594db490a1817660f8b899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:32 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47950
I20260811 01:41:32.381487 2895 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a800d85e0594db490a1817660f8b899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:32 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:40342
I20260811 01:41:32.382973 3041 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a800d85e0594db490a1817660f8b899 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:32 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47134
I20260811 01:41:32.394398 3156 tablet_replica.cc:330] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: stopping tablet replica
I20260811 01:41:32.395145 3156 raft_consensus.cc:2229] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:41:32.396085 3156 raft_consensus.cc:2258] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:32.397429 3157 tablet_replica.cc:330] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: stopping tablet replica
I20260811 01:41:32.397935 3157 raft_consensus.cc:2229] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:32.398631 3157 raft_consensus.cc:2258] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:32.399263 3156 ts_tablet_manager.cc:1905] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:32.400864 3157 ts_tablet_manager.cc:1905] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:32.406963 3160 tablet_replica.cc:330] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: stopping tablet replica
I20260811 01:41:32.407488 3160 raft_consensus.cc:2229] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:32.407756 3156 ts_tablet_manager.cc:1918] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:32.407976 3156 log.cc:1196] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/5a800d85e0594db490a1817660f8b899
I20260811 01:41:32.408099 3160 raft_consensus.cc:2258] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:32.408133 3157 ts_tablet_manager.cc:1918] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:32.408320 3157 log.cc:1196] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/5a800d85e0594db490a1817660f8b899
I20260811 01:41:32.408634 3156 ts_tablet_manager.cc:1939] T 5a800d85e0594db490a1817660f8b899 P efb9b7f451a2475ba367281b9aa7f66e: Deleting consensus metadata
I20260811 01:41:32.408903 3157 ts_tablet_manager.cc:1939] T 5a800d85e0594db490a1817660f8b899 P cd5af835c0594c82aed25dc41143440f: Deleting consensus metadata
I20260811 01:41:32.410768 2591 catalog_manager.cc:4841] TS cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113): tablet 5a800d85e0594db490a1817660f8b899 (table test-table [id=607270b484324095ae2604105a762a1d]) successfully deleted
I20260811 01:41:32.410912 2592 catalog_manager.cc:4841] TS efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1:34951): tablet 5a800d85e0594db490a1817660f8b899 (table test-table [id=607270b484324095ae2604105a762a1d]) successfully deleted
I20260811 01:41:32.413371 3160 ts_tablet_manager.cc:1905] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:32.420915 3160 ts_tablet_manager.cc:1918] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:32.421116 3160 log.cc:1196] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/5a800d85e0594db490a1817660f8b899
Aug 11 01:41:32 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:41:32.421638 3160 ts_tablet_manager.cc:1939] T 5a800d85e0594db490a1817660f8b899 P 95144307ff1c4878a8009a3d63c7f865: Deleting consensus metadata
I20260811 01:41:32.423866 2592 catalog_manager.cc:4841] TS 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345): tablet 5a800d85e0594db490a1817660f8b899 (table test-table [id=607270b484324095ae2604105a762a1d]) successfully deleted
I20260811 01:41:32.430485 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.383555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47968 (local address 127.17.132.1:34951)
0811 01:41:32.388142 (+ 4587us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.388149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.409256 (+ 21107us) server_negotiation.cc:407] Connection header received
0811 01:41:32.409599 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.409606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.409693 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.409820 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:32.412243 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.413517 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.415750 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.416478 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.416611 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.422762 (+ 6151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:32.422785 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:32.422804 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:32.422876 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:32.426745 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.427939 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.427948 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.427951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.428151 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.428677 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.428682 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.428684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.429103 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:32.429359 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.429872 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.430093 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4435}
I20260811 01:41:32.431313 2811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:32.538820 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2673
I20260811 01:41:32.561407 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2823
Aug 11 01:41:32 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:41:32.584367 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.562442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40358 (local address 127.17.132.2:44113)
0811 01:41:32.562670 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.562677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.562804 (+ 127us) server_negotiation.cc:407] Connection header received
0811 01:41:32.563047 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.563052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.563125 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.563242 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:32.564626 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.565399 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.567006 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.567392 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.567497 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.578428 (+ 10931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:32.578447 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:32.578464 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:32.578516 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:32.581598 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.582342 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.582350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.582352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.582508 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.582889 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.582892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.582894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.583323 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:32.583568 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.583892 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.584106 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:41:32.585120 2961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:32.680107 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2823
I20260811 01:41:32.700872 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2973
Aug 11 01:41:32 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:41:32.717505 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:32.701673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47142 (local address 127.17.132.3:34345)
0811 01:41:32.701919 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:32.701924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:32.701943 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:41:32.702113 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:32.702117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:32.702184 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:32.702270 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:32.703538 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.704453 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.706082 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:32.706485 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:32.706606 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:32.711274 (+ 4668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:32.711291 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:32.711308 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:32.711349 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:32.714261 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.715172 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.715184 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.715189 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.715349 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:32.715785 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:32.715788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:32.715790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:32.716322 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:32.716557 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:32.716915 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 01:41:32.717126 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:41:32.718317 3104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:32.808163 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2973
I20260811 01:41:32.829385 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 2572
I20260811 01:41:32.830646 2640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:32.943194 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 2572
I20260811 01:41:52.969518 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--webserver_interface=127.17.132.62
--webserver_port=32997
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:41:53.322880 3165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:53.323266 3165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:53.323436 3165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:53.330983 3165 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:41:53.331094 3165 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:41:53.331188 3165 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:41:53.331283 3165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:41:53.331382 3165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:53.331496 3165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:53.331584 3165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:41:53.331665 3165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:41:53.341845 3165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=32997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:53.343225 3165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:53.344614 3165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:53.371596 3172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:53.371564 3175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:53.371642 3171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:53.372375 3165 server_base.cc:1034] running on GCE node
I20260811 01:41:53.373293 3165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:53.374979 3165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:53.376214 3165 hybrid_clock.cc:648] HybridClock initialized: now 1786412513376146 us; error 31 us; skew 500 ppm
I20260811 01:41:53.376621 3165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:53 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412513, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:53.384877 3165 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:41:53.386976 3165 webserver.cc:460] Webserver started at http://127.17.132.62:32997/ using document root <none> and password file <none>
I20260811 01:41:53.387943 3165 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:53.388146 3165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:53.395531 3165 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 01:41:53.399121 3182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:53.400695 3165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:41:53.400936 3165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "ba4c1600d277438babf1f1413ccec43b"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "1df6250b68eab2560df99529dbfa9cc1"
server_key_iv: "93796f672148db3c93043e0d2a373f49"
server_key_version: "encryptionkey@0"
I20260811 01:41:53.402329 3165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:53.422892 3165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:53.428733 3165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:53.429008 3165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:53.448992 3165 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34739
I20260811 01:41:53.449018 3236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34739 every 8 connection(s)
I20260811 01:41:53.450697 3165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:41:53.451864 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3165
I20260811 01:41:53.452725 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:34951
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=34345
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:41:53.458565 3237 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:41:53.462086 3237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap starting.
I20260811 01:41:53.483855 3237 log.cc:824] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:53.496779 3237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:41:53.497360 3237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap complete.
I20260811 01:41:53.507196 3237 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:53.508119 3237 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Initialized, Role: FOLLOWER
I20260811 01:41:53.508757 3237 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:53.509019 3237 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:41:53.509156 3237 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:41:53.509361 3237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:41:53.513382 3237 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:53.514032 3237 leader_election.cc:302] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba4c1600d277438babf1f1413ccec43b; no voters:
I20260811 01:41:53.514751 3237 leader_election.cc:288] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:41:53.514894 3241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:41:53.517372 3237 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:41:53.522188 3241 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 LEADER]: Becoming Leader. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Running, Role: LEADER
I20260811 01:41:53.522933 3241 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:41:53.525897 3242 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:41:53.526350 3242 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:53.526942 3244 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba4c1600d277438babf1f1413ccec43b. Latest consensus state: current_term: 2 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:41:53.527275 3244 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:41:53.539139 3252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:41:53.547616 3252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:41:53.549208 3252 catalog_manager.cc:1259] Loaded cluster ID: 1aca75cc53654fee826b84844e36d914
I20260811 01:41:53.549384 3252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:41:53.554338 3252 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:41:53.555958 3252 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Loaded TSK: 0
I20260811 01:41:53.584884 3252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Generated new TSK 1
I20260811 01:41:53.585348 3252 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:41:53.829123 3239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:53.829435 3239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:53.829595 3239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:53.837303 3239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:53.837428 3239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:53.837603 3239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:41:53.852638 3239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:34951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=34345
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:53.854146 3239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:53.855532 3239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:53.869331 3267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:53.869626 3268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:53.869724 3272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:53.870536 3239 server_base.cc:1034] running on GCE node
I20260811 01:41:53.871244 3239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:53.872332 3239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:53.873556 3239 hybrid_clock.cc:648] HybridClock initialized: now 1786412513873490 us; error 54 us; skew 500 ppm
I20260811 01:41:53.873939 3239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:53 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412513, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:53.877950 3239 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:41:53.879863 3239 webserver.cc:460] Webserver started at http://127.17.132.1:34345/ using document root <none> and password file <none>
I20260811 01:41:53.880731 3239 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:53.880885 3239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:53.888175 3239 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:41:53.891721 3279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:53.893453 3239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 01:41:53.893673 3239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "efb9b7f451a2475ba367281b9aa7f66e"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "7d598aed2dfffb4c709f52d70b5c4e18"
server_key_iv: "dc0756fdfd8ab948c86aefb07ec71921"
server_key_version: "encryptionkey@0"
I20260811 01:41:53.895263 3239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:53.920838 3239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:53.926226 3239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:53.926549 3239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:53.927783 3239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:53.929339 3239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:53.929428 3239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:53.929513 3239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:53.929579 3239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:53.963454 3239 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34951
I20260811 01:41:53.963547 3400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34951 every 8 connection(s)
I20260811 01:41:53.965019 3239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:41:53.970489 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3239
I20260811 01:41:53.971197 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:44113
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=46185
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:41:53 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412513, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:53.990713 3403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:53.967956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:58037 (local address 127.17.132.62:34739)
0811 01:41:53.968581 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:53.968593 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:53.969134 (+ 541us) server_negotiation.cc:407] Connection header received
0811 01:41:53.971492 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:53.971513 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:53.971950 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:53.972377 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:53.973844 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:53.975874 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:53.977507 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:53.978670 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:53.978881 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:53.982587 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:53.982600 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:53.982623 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:53.982682 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:53.985749 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:53.986732 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:53.986739 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:53.986743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:53.986906 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:53.987449 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:53.987451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:53.987453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:53.987983 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:53.988184 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:53.988962 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 01:41:53.989350 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":298,"threads_started":1}
I20260811 01:41:53.990713 3404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:53.968095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:58037)
0811 01:41:53.968953 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:53.968998 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:53.970843 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:53.972461 (+ 1618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:53.972470 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:53.972976 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:53.973612 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:53.973634 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:53.976158 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:53.976162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:53.977355 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:53.977367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:53.978897 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:53.978902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:53.979111 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:53.979800 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:53.979830 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:53.982274 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:53.985932 (+ 3658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:53.985944 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:53.985963 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:53.986604 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:53.987038 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:53.987046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:53.987053 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:53.987333 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:53.988139 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:53.988148 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:53.988484 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 01:41:53.988774 (+ 290us) client_negotiation.cc:240] Negotiation successful
0811 01:41:53.989341 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":394,"threads_started":1}
I20260811 01:41:53.993878 3401 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:53.994189 3401 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:53.994932 3401 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:53.997399 3199 ts_manager.cc:194] Registered new tserver with Master: efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1:34951)
I20260811 01:41:53.999825 3199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:58037
W20260811 01:41:54.320439 3405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:54.320744 3405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:54.320843 3405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:54.328341 3405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:54.328466 3405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:54.328591 3405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:41:54.338670 3405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:44113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=46185
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:54.340013 3405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:54.341256 3405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:54.354415 3411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:54.354517 3415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:54.354408 3413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:54.355151 3405 server_base.cc:1034] running on GCE node
I20260811 01:41:54.355832 3405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:54.356783 3405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:54.358003 3405 hybrid_clock.cc:648] HybridClock initialized: now 1786412514357956 us; error 41 us; skew 500 ppm
I20260811 01:41:54.358335 3405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:54 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412514, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:54.361539 3405 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:41:54.363117 3405 webserver.cc:460] Webserver started at http://127.17.132.2:46185/ using document root <none> and password file <none>
I20260811 01:41:54.363827 3405 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:54.363986 3405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:54.369410 3405 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:41:54.372723 3422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.374125 3405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:41:54.374343 3405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "cd5af835c0594c82aed25dc41143440f"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "d6cfc381bbced5af5969c37b8ec3fcf7"
server_key_iv: "621cce981c2e284d6cf95fc363d4df48"
server_key_version: "encryptionkey@0"
I20260811 01:41:54.375376 3405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:54.388945 3405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:54.393543 3405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:54.393886 3405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:54.394935 3405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:54.396317 3405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:54.396445 3405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.396565 3405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:54.396649 3405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.432542 3405 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:44113
I20260811 01:41:54.432632 3542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:44113 every 8 connection(s)
I20260811 01:41:54.434275 3405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:41:54.435861 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3405
I20260811 01:41:54.436623 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:34345
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=33719
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:41:54 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412514, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:54.458456 3403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.437208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:55243 (local address 127.17.132.62:34739)
0811 01:41:54.437435 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:54.437441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:54.438842 (+ 1401us) server_negotiation.cc:407] Connection header received
0811 01:41:54.440732 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:54.440741 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:54.440840 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:54.440969 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:54.442561 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.443715 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.445405 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.446156 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.446314 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.450222 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:54.450229 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:54.450234 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:54.450280 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:54.454113 (+ 3833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.455244 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.455250 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.455255 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.455430 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.455997 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.456002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.456005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.456469 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:54.456626 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:54.457567 (+ 941us) server_negotiation.cc:299] Negotiation successful
0811 01:41:54.457893 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:41:54.459815 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.437746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:55243)
0811 01:41:54.438656 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:54.438707 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:54.440445 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:54.441199 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:54.441207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:54.441732 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:54.442384 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:54.442402 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.443910 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.443914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:54.445234 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:54.445259 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.446393 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.446398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:54.446630 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.447381 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:54.447405 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:54.449947 (+ 2542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:54.454306 (+ 4359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:54.454320 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:54.454341 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:54.455089 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:54.455565 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:54.455573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:54.455580 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:54.455852 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:54.456631 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:54.456643 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:54.457123 (+ 480us) client_negotiation.cc:769] Sending connection context
0811 01:41:54.457445 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 01:41:54.458127 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":365,"threads_started":1}
I20260811 01:41:54.461549 3543 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:54.461969 3543 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:54.462989 3543 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:54.464993 3199 ts_manager.cc:194] Registered new tserver with Master: cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:54.466192 3199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:55243
W20260811 01:41:54.794394 3547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:41:54.794767 3547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:41:54.794952 3547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:41:54.802495 3547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:41:54.802651 3547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:41:54.802821 3547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:41:54.812824 3547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:34345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=33719
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:41:54.814263 3547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:41:54.815604 3547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:41:54.829209 3553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:54.829336 3554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:41:54.829227 3556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:41:54.830711 3547 server_base.cc:1034] running on GCE node
I20260811 01:41:54.831372 3547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:41:54.832306 3547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:41:54.833532 3547 hybrid_clock.cc:648] HybridClock initialized: now 1786412514833479 us; error 46 us; skew 500 ppm
I20260811 01:41:54.833904 3547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:41:54 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412514, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:41:54.837074 3547 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:41:54.838644 3547 webserver.cc:460] Webserver started at http://127.17.132.3:33719/ using document root <none> and password file <none>
I20260811 01:41:54.839325 3547 fs_manager.cc:359] Metadata directory not provided
I20260811 01:41:54.839449 3547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:41:54.844650 3547 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 01:41:54.847338 3563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.848701 3547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:41:54.849050 3547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "95144307ff1c4878a8009a3d63c7f865"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "61c1dab7beccf15237c53f8bc8a649b6"
server_key_iv: "548a014ec6796fe5f4c8514bb7f89747"
server_key_version: "encryptionkey@0"
I20260811 01:41:54.850238 3547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:41:54.867551 3547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:41:54.872092 3547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:41:54.872390 3547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:41:54.873469 3547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:41:54.874915 3547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:41:54.875036 3547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.875167 3547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:41:54.875245 3547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:41:54.911051 3547 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:34345
I20260811 01:41:54.911198 3687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:34345 every 8 connection(s)
I20260811 01:41:54.912547 3547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:41:54.922572 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3547
Aug 11 01:41:54 dist-test-slave-0kls krb5kdc[2557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412514, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:41:54.934567 3403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.915066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:60481 (local address 127.17.132.62:34739)
0811 01:41:54.915240 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:54.915244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:54.916379 (+ 1135us) server_negotiation.cc:407] Connection header received
0811 01:41:54.918463 (+ 2084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:54.918470 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:54.918559 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:54.918668 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:54.920131 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.920870 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.922669 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.923119 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.923242 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.927474 (+ 4232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:54.927480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:54.927485 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:54.927522 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:54.930759 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.931783 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.931787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.931789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.931909 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.932454 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.932457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.932459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.932697 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:54.932808 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:54.933874 (+ 1066us) server_negotiation.cc:299] Negotiation successful
0811 01:41:54.934115 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:41:54.935607 3690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.915500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:60481)
0811 01:41:54.916223 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:54.916269 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:54.918182 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:54.918896 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:54.918904 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:54.919408 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:41:54.919958 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:54.919975 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.921041 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.921051 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:54.922511 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:54.922527 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.923356 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.923365 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:54.923677 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.924483 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:41:54.924504 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:41:54.927174 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:41:54.930938 (+ 3764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:54.930950 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:54.930967 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:54.931646 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:54.932029 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:41:54.932036 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:41:54.932042 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:41:54.932327 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:41:54.932833 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:41:54.932844 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:41:54.933322 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 01:41:54.933678 (+ 356us) client_negotiation.cc:240] Negotiation successful
0811 01:41:54.934272 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":264,"threads_started":1}
I20260811 01:41:54.937306 3688 heartbeater.cc:347] Connected to a master server at 127.17.132.62:34739
I20260811 01:41:54.937669 3688 heartbeater.cc:464] Registering TS with master...
I20260811 01:41:54.938594 3688 heartbeater.cc:511] Master 127.17.132.62:34739 requested a full tablet report, sending...
I20260811 01:41:54.940042 3691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.923520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36916 (local address 127.17.132.62:34739)
0811 01:41:54.924439 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:54.924445 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:54.924464 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:41:54.924648 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:54.924657 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:54.924711 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:54.924830 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:54.926888 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.927884 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.929277 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.930056 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.930193 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.933811 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:54.933819 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:54.933828 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:54.933885 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:54.937109 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.937925 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.937934 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.937937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.938055 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.938447 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.938453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.938456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.938746 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:54.939046 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:54.939348 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 01:41:54.939618 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"spinlock_wait_cycles":7424,"thread_start_us":309,"threads_started":1}
I20260811 01:41:54.940342 3199 ts_manager.cc:194] Registered new tserver with Master: 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345)
I20260811 01:41:54.941414 3199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:60481
I20260811 01:41:54.942847 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:41:54.949461 3691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.943760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.17.132.62:34739)
0811 01:41:54.943912 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:54.943916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:54.944422 (+ 506us) server_negotiation.cc:407] Connection header received
0811 01:41:54.944553 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:54.944557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:54.944692 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:54.944844 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:54.945223 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.946019 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.947582 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.948038 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.948167 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.948604 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:54.948865 (+ 261us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 01:41:54.949166 (+ 301us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36930: token expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 01:41:54.949592 3691 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36930: token expired
W20260811 01:41:54.950063 3116 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.132.62:34739)
I20260811 01:41:54.963691 3691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.950629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36944 (local address 127.17.132.62:34739)
0811 01:41:54.950791 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:54.950795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:54.950812 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:41:54.950912 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:54.950915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:54.950970 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:54.951064 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:54.952449 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.953164 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.954688 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:54.955118 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:54.955229 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:54.957771 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:54.957776 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:54.957779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:54.957886 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:54.960647 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.961438 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.961443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.961445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.961593 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:54.962069 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:54.962076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:54.962080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:54.962421 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:54.962695 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:54.963076 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 01:41:54.963312 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:41:54.967917 3198 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:41:54.976553 3198 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:41:55.004472 3401 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:55.015565 3704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.990646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48540 (local address 127.17.132.2:44113)
0811 01:41:55.003053 (+ 12407us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.003067 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.004812 (+ 1745us) server_negotiation.cc:407] Connection header received
0811 01:41:55.005283 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.005294 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.005562 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.005733 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:55.006900 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.008365 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.012697 (+ 4332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.014287 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.014437 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.014643 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.015047 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.015257 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12130,"thread_start_us":12441,"threads_started":1}
I20260811 01:41:55.015604 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.990169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44113 (local address 127.0.0.1:48540)
0811 01:41:55.004662 (+ 14493us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.004685 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:55.004990 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:55.006109 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:55.006116 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:55.006147 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:55.006668 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.006682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.008538 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.008543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.011694 (+ 3151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.011712 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.014532 (+ 2820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.014540 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.014754 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.014818 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 01:41:55.014955 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 01:41:55.015155 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14349,"mutex_wait_us":4,"thread_start_us":14955,"threads_started":1}
I20260811 01:41:55.015774 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.989940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.17.132.1:34951)
0811 01:41:55.003957 (+ 14017us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.003969 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.004801 (+ 832us) server_negotiation.cc:407] Connection header received
0811 01:41:55.005285 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.005294 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.005558 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.005731 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:55.007106 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.009279 (+ 2173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.012763 (+ 3484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.014287 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.014437 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.014678 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.015236 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.015408 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13791,"thread_start_us":13616,"threads_started":1}
I20260811 01:41:55.016855 3699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:54.989620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38346)
0811 01:41:55.004605 (+ 14985us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.004665 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:55.005019 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:55.006144 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:55.006152 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:55.006186 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:55.006842 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.006858 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.009495 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.009504 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.012575 (+ 3071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.012589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.014826 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.014831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.015024 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.015058 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:41:55.016251 (+ 1193us) client_negotiation.cc:240] Negotiation successful
0811 01:41:55.016396 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14693,"mutex_wait_us":339,"thread_start_us":14510,"threads_started":1}
I20260811 01:41:55.020015 3476 tablet_service.cc:1467] Processing CreateTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 (DEFAULT_TABLE table=test-table [id=998e5005d0fc4deaac4a97485a9b8314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:55.020764 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.009213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:34345 (local address 127.0.0.1:46150)
0811 01:41:55.012125 (+ 2912us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.012152 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:55.012312 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:55.013650 (+ 1338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:55.013655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:55.013682 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:55.014113 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.014127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.016021 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.016025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.017984 (+ 1959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.018001 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.019978 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.019987 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.020172 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.020205 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:41:55.020300 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:41:55.020432 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2712,"thread_start_us":3224,"threads_started":1}
I20260811 01:41:55.020920 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.005563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.17.132.3:34345)
0811 01:41:55.013141 (+ 7578us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.013148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.013177 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:41:55.013260 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.013265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.013458 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.013738 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:55.014296 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.015860 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.018241 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.019710 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.019863 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.020107 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.020396 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.020560 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7398,"thread_start_us":7236,"threads_started":1}
I20260811 01:41:55.020728 3330 tablet_service.cc:1467] Processing CreateTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 (DEFAULT_TABLE table=test-table [id=998e5005d0fc4deaac4a97485a9b8314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:55.021893 3476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ef22510b2f84a55962d53d6726e0ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:55.023013 3330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ef22510b2f84a55962d53d6726e0ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:55.025029 3617 tablet_service.cc:1467] Processing CreateTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 (DEFAULT_TABLE table=test-table [id=998e5005d0fc4deaac4a97485a9b8314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:41:55.026604 3617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ef22510b2f84a55962d53d6726e0ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:41:55.034986 3707 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Bootstrap starting.
I20260811 01:41:55.038362 3707 tablet_bootstrap.cc:654] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:55.039484 3707 log.cc:824] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:55.042786 3710 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Bootstrap starting.
I20260811 01:41:55.044878 3709 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Bootstrap starting.
I20260811 01:41:55.046787 3707 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: No bootstrap required, opened a new log
I20260811 01:41:55.047088 3707 ts_tablet_manager.cc:1397] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260811 01:41:55.047752 3710 tablet_bootstrap.cc:654] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:55.048564 3709 tablet_bootstrap.cc:654] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Neither blocks nor log segments found. Creating new log.
I20260811 01:41:55.049070 3710 log.cc:824] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:55.049901 3709 log.cc:824] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:41:55.052930 3710 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: No bootstrap required, opened a new log
I20260811 01:41:55.053318 3710 ts_tablet_manager.cc:1397] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:41:55.056257 3709 tablet_bootstrap.cc:492] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: No bootstrap required, opened a new log
I20260811 01:41:55.056185 3707 raft_consensus.cc:348] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.056589 3709 ts_tablet_manager.cc:1397] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260811 01:41:55.056670 3707 raft_consensus.cc:374] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:55.056775 3707 raft_consensus.cc:729] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd5af835c0594c82aed25dc41143440f, State: Initialized, Role: FOLLOWER
I20260811 01:41:55.057405 3707 consensus_queue.cc:260] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.064445 3710 raft_consensus.cc:348] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.064921 3710 raft_consensus.cc:374] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:55.065083 3710 raft_consensus.cc:729] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95144307ff1c4878a8009a3d63c7f865, State: Initialized, Role: FOLLOWER
I20260811 01:41:55.065970 3710 consensus_queue.cc:260] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.066322 3543 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:55.067132 3688 heartbeater.cc:503] Master 127.17.132.62:34739 was elected leader, sending a full tablet report...
I20260811 01:41:55.067189 3707 ts_tablet_manager.cc:1428] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Time spent starting tablet: real 0.020s user 0.007s sys 0.013s
I20260811 01:41:55.067761 3710 ts_tablet_manager.cc:1428] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Time spent starting tablet: real 0.014s user 0.005s sys 0.008s
I20260811 01:41:55.069166 3709 raft_consensus.cc:348] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.069675 3709 raft_consensus.cc:374] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:41:55.069816 3709 raft_consensus.cc:729] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb9b7f451a2475ba367281b9aa7f66e, State: Initialized, Role: FOLLOWER
I20260811 01:41:55.070459 3709 consensus_queue.cc:260] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.072378 3709 ts_tablet_manager.cc:1428] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Time spent starting tablet: real 0.016s user 0.009s sys 0.004s
I20260811 01:41:55.123168 3715 raft_consensus.cc:482] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:41:55.123535 3715 raft_consensus.cc:504] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.125263 3715 leader_election.cc:288] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345), cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:55.133426 3704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.125931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:43665 (local address 127.17.132.2:44113)
0811 01:41:55.126247 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.126256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.127052 (+ 796us) server_negotiation.cc:407] Connection header received
0811 01:41:55.127665 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.127669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.127727 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.127797 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:55.128440 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.129479 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.131573 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.132373 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.132558 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.132657 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.132987 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.133133 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260811 01:41:55.133445 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.125817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:56419 (local address 127.17.132.3:34345)
0811 01:41:55.126041 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.126050 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.127052 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 01:41:55.127305 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.127314 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.127396 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.127496 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:41:55.128171 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.129318 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.131528 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.132369 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.132580 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.132663 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.133047 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.133180 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:41:55.133563 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.125869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44113 (local address 127.17.132.1:43665)
0811 01:41:55.126915 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.126938 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:55.127114 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:55.127852 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:55.127858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:55.127889 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:55.128276 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.128286 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.129633 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.129639 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.131392 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.131406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.132622 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.132629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.132820 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.132852 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 01:41:55.132930 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:41:55.133101 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":888,"mutex_wait_us":42,"thread_start_us":483,"threads_started":1}
I20260811 01:41:55.133859 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.125876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:34345 (local address 127.17.132.1:56419)
0811 01:41:55.126958 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.126976 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:41:55.127130 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:41:55.127546 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:41:55.127550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:41:55.127572 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:41:55.127951 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.127964 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.129490 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.129496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.131340 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:41:55.131358 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.132676 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.132684 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:41:55.132857 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.132881 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:41:55.132991 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:41:55.133127 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"mutex_wait_us":118,"thread_start_us":679,"threads_started":1}
I20260811 01:41:55.134645 3496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ef22510b2f84a55962d53d6726e0ec3" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd5af835c0594c82aed25dc41143440f" is_pre_election: true
I20260811 01:41:55.134981 3640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ef22510b2f84a55962d53d6726e0ec3" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95144307ff1c4878a8009a3d63c7f865" is_pre_election: true
I20260811 01:41:55.135192 3496 raft_consensus.cc:2454] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 0.
I20260811 01:41:55.135643 3640 raft_consensus.cc:2454] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 0.
I20260811 01:41:55.136502 3283 leader_election.cc:302] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95144307ff1c4878a8009a3d63c7f865, efb9b7f451a2475ba367281b9aa7f66e; no voters:
I20260811 01:41:55.137077 3715 raft_consensus.cc:2781] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:41:55.137274 3715 raft_consensus.cc:482] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:41:55.137393 3715 raft_consensus.cc:3037] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:55.139786 3715 raft_consensus.cc:504] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.140483 3715 leader_election.cc:288] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 election: Requested vote from peers 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345), cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113)
I20260811 01:41:55.141106 3496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ef22510b2f84a55962d53d6726e0ec3" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd5af835c0594c82aed25dc41143440f"
I20260811 01:41:55.141100 3640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ef22510b2f84a55962d53d6726e0ec3" candidate_uuid: "efb9b7f451a2475ba367281b9aa7f66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95144307ff1c4878a8009a3d63c7f865"
I20260811 01:41:55.141336 3496 raft_consensus.cc:3037] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:55.141358 3640 raft_consensus.cc:3037] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:41:55.143761 3496 raft_consensus.cc:2454] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 1.
I20260811 01:41:55.143822 3640 raft_consensus.cc:2454] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb9b7f451a2475ba367281b9aa7f66e in term 1.
I20260811 01:41:55.144281 3282 leader_election.cc:302] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd5af835c0594c82aed25dc41143440f, efb9b7f451a2475ba367281b9aa7f66e; no voters:
I20260811 01:41:55.144654 3715 raft_consensus.cc:2781] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:41:55.145128 3715 raft_consensus.cc:686] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 1 LEADER]: Becoming Leader. State: Replica: efb9b7f451a2475ba367281b9aa7f66e, State: Running, Role: LEADER
I20260811 01:41:55.145639 3715 consensus_queue.cc:237] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } }
I20260811 01:41:55.150753 3198 catalog_manager.cc:5495] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e reported cstate change: term changed from 0 to 1, leader changed from <none> to efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1). New cstate: current_term: 1 leader_uuid: "efb9b7f451a2475ba367281b9aa7f66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb9b7f451a2475ba367281b9aa7f66e" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 34951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 } health_report { overall_health: UNKNOWN } } }
W20260811 01:41:55.164255 3689 tablet.cc:2369] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:41:55.172040 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.166269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38362 (local address 127.17.132.1:34951)
0811 01:41:55.166498 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.166506 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.166571 (+ 65us) server_negotiation.cc:407] Connection header received
0811 01:41:55.166834 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.166838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.166927 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.167088 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:41:55.167486 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.168270 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.169692 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.170179 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.170309 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.170880 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:41:55.171432 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:41:55.171630 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.171684 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.171772 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:41:55.180680 3496 raft_consensus.cc:1261] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Refusing update from remote peer efb9b7f451a2475ba367281b9aa7f66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:55.181634 3640 raft_consensus.cc:1261] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Refusing update from remote peer efb9b7f451a2475ba367281b9aa7f66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:41:55.181782 3718 consensus_queue.cc:1035] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd5af835c0594c82aed25dc41143440f" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:41:55.182492 3715 consensus_queue.cc:1035] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95144307ff1c4878a8009a3d63c7f865" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:41:55.188817 3544 tablet.cc:2369] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:41:55.199275 3721 mvcc.cc:205] Tried to move back new op lower bound from 7317145662169538560 to 7317145662041620480. Current Snapshot: MvccSnapshot[applied={T|T < 7317145662169538560}]
I20260811 01:41:55.211175 3199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:55.211476 3199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:41:55.215260 3199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Sending DeleteTablet for 3 replicas of tablet 2ef22510b2f84a55962d53d6726e0ec3
I20260811 01:41:55.216768 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 3239
I20260811 01:41:55.216756 3476 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:55 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:48540
I20260811 01:41:55.216985 3330 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:55 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:38346
I20260811 01:41:55.217760 3617 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ef22510b2f84a55962d53d6726e0ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:41:55 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:46150
I20260811 01:41:55.217984 3733 tablet_replica.cc:330] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: stopping tablet replica
I20260811 01:41:55.218641 3732 tablet_replica.cc:330] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: stopping tablet replica
I20260811 01:41:55.219170 3734 tablet_replica.cc:330] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: stopping tablet replica
I20260811 01:41:55.219156 3732 raft_consensus.cc:2229] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:55.219218 3733 raft_consensus.cc:2229] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:41:55.219666 3734 raft_consensus.cc:2229] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:41:55.219736 3732 raft_consensus.cc:2258] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:55.219966 3733 raft_consensus.cc:2258] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:55.220427 3734 raft_consensus.cc:2258] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:41:55.222383 3733 ts_tablet_manager.cc:1905] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:55.222558 3734 ts_tablet_manager.cc:1905] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:55.227200 3732 ts_tablet_manager.cc:1905] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:41:55.230719 3734 ts_tablet_manager.cc:1918] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:55.230994 3734 log.cc:1196] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/2ef22510b2f84a55962d53d6726e0ec3
I20260811 01:41:55.231705 3734 ts_tablet_manager.cc:1939] T 2ef22510b2f84a55962d53d6726e0ec3 P 95144307ff1c4878a8009a3d63c7f865: Deleting consensus metadata
I20260811 01:41:55.234028 3186 catalog_manager.cc:4841] TS 95144307ff1c4878a8009a3d63c7f865 (127.17.132.3:34345): tablet 2ef22510b2f84a55962d53d6726e0ec3 (table test-table [id=998e5005d0fc4deaac4a97485a9b8314]) successfully deleted
I20260811 01:41:55.234802 3732 ts_tablet_manager.cc:1918] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:55.235076 3732 log.cc:1196] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/2ef22510b2f84a55962d53d6726e0ec3
I20260811 01:41:55.235786 3732 ts_tablet_manager.cc:1939] T 2ef22510b2f84a55962d53d6726e0ec3 P cd5af835c0594c82aed25dc41143440f: Deleting consensus metadata
I20260811 01:41:55.237972 3185 catalog_manager.cc:4841] TS cd5af835c0594c82aed25dc41143440f (127.17.132.2:44113): tablet 2ef22510b2f84a55962d53d6726e0ec3 (table test-table [id=998e5005d0fc4deaac4a97485a9b8314]) successfully deleted
I20260811 01:41:55.238641 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.218658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.17.132.1:34951)
0811 01:41:55.218844 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.218850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.218868 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:41:55.218928 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.218932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.219059 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.219184 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:55.221553 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.222705 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.224667 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.225548 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.225694 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.229708 (+ 4014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:55.229724 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:55.229743 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:55.229825 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:55.234210 (+ 4385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.235353 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.235368 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.235374 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.235594 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.236131 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.236140 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.236146 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.236674 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:55.237043 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.238003 (+ 960us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.238294 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:41:55.239821 3396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:55.338933 3733 ts_tablet_manager.cc:1918] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:41:55.339395 3733 log.cc:1196] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/2ef22510b2f84a55962d53d6726e0ec3
I20260811 01:41:55.339771 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 3239
I20260811 01:41:55.361558 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 3405
W20260811 01:41:55.361503 3186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:34951 (error 108)
I20260811 01:41:55.363524 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.363017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38390)
0811 01:41:55.363223 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.363342 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 01:41:55.363763 3186 catalog_manager.cc:4584] TS efb9b7f451a2475ba367281b9aa7f66e (127.17.132.1:34951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ef22510b2f84a55962d53d6726e0ec3: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
I20260811 01:41:55.379945 3704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.362429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48548 (local address 127.17.132.2:44113)
0811 01:41:55.362625 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.362630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.362889 (+ 259us) server_negotiation.cc:407] Connection header received
0811 01:41:55.363108 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.363115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.363212 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.363324 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:55.364795 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.365559 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.366941 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.367378 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.367483 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.374263 (+ 6780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:55.374279 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:55.374296 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:55.374337 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:55.377339 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.378109 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.378117 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.378119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.378245 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.378577 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.378584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.378587 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.378960 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:55.379253 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.379463 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.379633 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:41:55.380602 3538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:55.417586 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.417069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38404)
0811 01:41:55.417305 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.417413 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 01:41:55.418783 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.418405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38406)
0811 01:41:55.418551 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.418630 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 01:41:55.479142 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.478704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38408)
0811 01:41:55.478903 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.478987 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:41:55.480155 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.479834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38422)
0811 01:41:55.479982 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.480047 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 01:41:55.483604 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 3405
I20260811 01:41:55.505057 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 3547
I20260811 01:41:55.519378 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.505899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.17.132.3:34345)
0811 01:41:55.506088 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:41:55.506094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:41:55.506193 (+ 99us) server_negotiation.cc:407] Connection header received
0811 01:41:55.506414 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:41:55.506418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:41:55.506546 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:41:55.506654 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:41:55.508105 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.508847 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.510396 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:41:55.510807 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:41:55.510941 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:41:55.513604 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:41:55.513621 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:41:55.513637 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:41:55.513673 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:41:55.516526 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.517260 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.517269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.517271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.517443 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:41:55.517879 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:41:55.517884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:41:55.517887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:41:55.518302 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:41:55.518637 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 01:41:55.518925 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 01:41:55.519119 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:41:55.520056 3682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:55.560798 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.560295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38424)
0811 01:41:55.560521 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.560608 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 01:41:55.562126 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.561604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38438)
0811 01:41:55.561886 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.561965 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 01:41:55.610842 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 3547
I20260811 01:41:55.632054 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 3165
I20260811 01:41:55.633324 3232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:41:55.749047 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:41:55.748386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:34951 (local address 127.0.0.1:38440)
0811 01:41:55.748577 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:41:55.748704 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:34951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 01:41:55.749200 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 3165
I20260811 01:42:15.772960 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--webserver_interface=127.17.132.62
--webserver_port=32997
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:34739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:16.140527 3740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:16.140910 3740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:16.141075 3740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:16.148622 3740 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:42:16.148787 3740 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:42:16.148877 3740 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:42:16.148973 3740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:16.149081 3740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:16.149206 3740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:16.149297 3740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:16.149379 3740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:16.160025 3740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:34739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:34739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=32997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:16.161568 3740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:16.163131 3740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:16.176010 3750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:16.176132 3747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:16.176124 3748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:16.177340 3740 server_base.cc:1034] running on GCE node
I20260811 01:42:16.178296 3740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:16.179894 3740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:16.181176 3740 hybrid_clock.cc:648] HybridClock initialized: now 1786412536181090 us; error 55 us; skew 500 ppm
I20260811 01:42:16.181529 3740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:16 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412536, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:16.190940 3740 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:42:16.192960 3740 webserver.cc:460] Webserver started at http://127.17.132.62:32997/ using document root <none> and password file <none>
I20260811 01:42:16.193913 3740 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:16.194077 3740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:16.200332 3740 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 01:42:16.203819 3757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:16.205248 3740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:16.205466 3740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "ba4c1600d277438babf1f1413ccec43b"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "1df6250b68eab2560df99529dbfa9cc1"
server_key_iv: "93796f672148db3c93043e0d2a373f49"
server_key_version: "encryptionkey@0"
I20260811 01:42:16.206637 3740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:16.226826 3740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:16.231207 3740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:16.231523 3740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:16.251623 3740 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:34739
I20260811 01:42:16.251669 3813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:34739 every 8 connection(s)
I20260811 01:42:16.253324 3740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:16.257300 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3740
I20260811 01:42:16.258276 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:34951
--local_ip_for_outbound_sockets=127.17.132.1
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=34345
--webserver_interface=127.17.132.1
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:42:16.260912 3814 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:42:16.264909 3814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap starting.
I20260811 01:42:16.293320 3814 log.cc:824] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:16.310495 3814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:42:16.311182 3814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Bootstrap complete.
I20260811 01:42:16.320973 3814 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:42:16.321998 3814 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Initialized, Role: FOLLOWER
I20260811 01:42:16.322796 3814 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:42:16.323079 3814 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:16.323246 3814 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:16.323458 3814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:42:16.328019 3814 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:42:16.328603 3814 leader_election.cc:302] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba4c1600d277438babf1f1413ccec43b; no voters:
I20260811 01:42:16.329399 3814 leader_election.cc:288] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:42:16.329542 3818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:42:16.330758 3818 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [term 3 LEADER]: Becoming Leader. State: Replica: ba4c1600d277438babf1f1413ccec43b, State: Running, Role: LEADER
I20260811 01:42:16.331457 3818 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } }
I20260811 01:42:16.331857 3814 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:16.334409 3820 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba4c1600d277438babf1f1413ccec43b. Latest consensus state: current_term: 3 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:42:16.334843 3820 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:16.334512 3819 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ba4c1600d277438babf1f1413ccec43b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba4c1600d277438babf1f1413ccec43b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 34739 } } }
I20260811 01:42:16.334964 3819 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:16.336090 3824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:16.357436 3824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:16.359324 3824 catalog_manager.cc:1259] Loaded cluster ID: 1aca75cc53654fee826b84844e36d914
I20260811 01:42:16.359522 3824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:16.364197 3824 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:16.366310 3824 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Loaded TSK: 0
I20260811 01:42:16.366546 3824 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba4c1600d277438babf1f1413ccec43b: Loaded TSK: 1
F20260811 01:42:16.367820 3824 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8caf49a9ad google::LogMessage::Fail() at ??:0
@ 0x7f8caf49d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8caf49a4de google::LogMessage::Flush() at ??:0
@ 0x7f8caf49ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8cb31fe7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8cb31ed73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8cc4ec91c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8cc4ec8783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8cc4f542a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f8cc4f540c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f8cc4f9e5e9 std::function<>::operator()() at ??:0
@ 0x7f8cc4ecccdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8cc4ecac36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8cc4f52610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8cc4f52439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8cb20e6345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8cb20e991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8cb20e9799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8cb20c4eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8cb539e6db start_thread at ??:0
@ 0x7f8cae33461f clone at ??:0
W20260811 01:42:16.709762 3816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:16.710196 3816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:16.710374 3816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:16.718102 3816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:16.718226 3816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:16.718413 3816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:16.728904 3816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:34951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=34345
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:16.730331 3816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:16.731686 3816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:16.746618 3865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:16.746658 3868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:16.746567 3866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:16.747967 3816 server_base.cc:1034] running on GCE node
I20260811 01:42:16.748682 3816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:16.749840 3816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:16.751098 3816 hybrid_clock.cc:648] HybridClock initialized: now 1786412536751056 us; error 35 us; skew 500 ppm
I20260811 01:42:16.751453 3816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:16 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412536, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:16.755121 3816 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:42:16.756855 3816 webserver.cc:460] Webserver started at http://127.17.132.1:34345/ using document root <none> and password file <none>
I20260811 01:42:16.757643 3816 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:16.757867 3816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:16.763934 3816 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 01:42:16.767345 3875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:16.768837 3816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:16.769047 3816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "efb9b7f451a2475ba367281b9aa7f66e"
format_stamp: "Formatted at 2026-08-11 01:41:30 on dist-test-slave-0kls"
server_key: "7d598aed2dfffb4c709f52d70b5c4e18"
server_key_iv: "dc0756fdfd8ab948c86aefb07ec71921"
server_key_version: "encryptionkey@0"
I20260811 01:42:16.770202 3816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:16.795042 3816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:16.800063 3816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:16.800486 3816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:16.801676 3816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:16.803864 3884 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260811 01:42:16.810274 3884 ts_tablet_manager.cc:1852] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260811 01:42:16.811363 3884 ts_tablet_manager.cc:1905] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:16.819523 3884 ts_tablet_manager.cc:1918] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:16.819890 3884 ts_tablet_manager.cc:1939] T 2ef22510b2f84a55962d53d6726e0ec3 P efb9b7f451a2475ba367281b9aa7f66e: Deleting consensus metadata
I20260811 01:42:16.820384 3816 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260811 01:42:16.820552 3816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260811 01:42:16.820721 3816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:16.820832 3816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:16.856930 3816 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:34951
I20260811 01:42:16.856988 3999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:34951 every 8 connection(s)
I20260811 01:42:16.858386 3816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:16.859710 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 3816
I20260811 01:42:16.860529 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:44113
--local_ip_for_outbound_sockets=127.17.132.2
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=46185
--webserver_interface=127.17.132.2
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:42:16.864390 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:16.862114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:41683)
0811 01:42:16.862963 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:16.863222 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":352,"threads_started":1}
W20260811 01:42:16.865247 4002 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34739 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:34739: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
I20260811 01:42:16.866253 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:16.865894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:44421)
0811 01:42:16.866056 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:16.866144 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 01:42:16.867180 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:16.866822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:33349)
0811 01:42:16.866968 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:16.867056 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:42:16.867441 4002 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:42:17.228107 4005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:17.228403 4005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:17.228499 4005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:17.235935 4005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:17.236052 4005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:17.236172 4005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:17.246414 4005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:44113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=46185
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:17.247709 4005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:17.249008 4005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:17.262272 4011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:17.262300 4013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:17.262812 4010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:17.263535 4005 server_base.cc:1034] running on GCE node
I20260811 01:42:17.264225 4005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:17.265211 4005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:17.266444 4005 hybrid_clock.cc:648] HybridClock initialized: now 1786412537266385 us; error 51 us; skew 500 ppm
I20260811 01:42:17.266829 4005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:17 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:17.270448 4005 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:42:17.271973 4005 webserver.cc:460] Webserver started at http://127.17.132.2:46185/ using document root <none> and password file <none>
I20260811 01:42:17.272751 4005 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:17.272909 4005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:17.278864 4005 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:42:17.281941 4023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.283435 4005 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:42:17.283571 4005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "cd5af835c0594c82aed25dc41143440f"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "d6cfc381bbced5af5969c37b8ec3fcf7"
server_key_iv: "621cce981c2e284d6cf95fc363d4df48"
server_key_version: "encryptionkey@0"
I20260811 01:42:17.284526 4005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:17.304744 4005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:17.309309 4005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:17.309547 4005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:17.310621 4005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:17.311978 4005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:17.312067 4005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.312153 4005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:17.312211 4005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.348199 4005 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:44113
I20260811 01:42:17.348292 4146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:44113 every 8 connection(s)
I20260811 01:42:17.349705 4005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:17.354725 4151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.352806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:40227)
0811 01:42:17.353557 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.353847 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":312,"threads_started":1}
I20260811 01:42:17.354745 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4005
W20260811 01:42:17.355347 4147 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34739 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:34739: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
I20260811 01:42:17.355377 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:34345
--local_ip_for_outbound_sockets=127.17.132.3
--tserver_master_addrs=127.17.132.62:34739
--webserver_port=33719
--webserver_interface=127.17.132.3
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:33853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:42:17.356328 4151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.355865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:60353)
0811 01:42:17.356058 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.356154 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 01:42:17.357350 4151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.356916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:39897)
0811 01:42:17.357091 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.357191 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:42:17.357640 4147 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:42:17.730526 4152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:17.730989 4152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:17.731221 4152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:17.742659 4152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:17.742837 4152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:17.743050 4152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:17.755136 4152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:34345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=33719
--tserver_master_addrs=127.17.132.62:34739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:17.756727 4152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:17.758462 4152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:17.775566 4158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:17.775575 4161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:17.775692 4159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:17.776656 4152 server_base.cc:1034] running on GCE node
I20260811 01:42:17.777400 4152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:17.778471 4152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:17.779687 4152 hybrid_clock.cc:648] HybridClock initialized: now 1786412537779643 us; error 34 us; skew 500 ppm
I20260811 01:42:17.780028 4152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:17 dist-test-slave-0kls krb5kdc[2557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:17.783469 4152 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:42:17.784940 4152 webserver.cc:460] Webserver started at http://127.17.132.3:33719/ using document root <none> and password file <none>
I20260811 01:42:17.785645 4152 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:17.785792 4152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:17.791539 4152 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 01:42:17.794242 4169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.795571 4152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 01:42:17.795771 4152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "95144307ff1c4878a8009a3d63c7f865"
format_stamp: "Formatted at 2026-08-11 01:41:31 on dist-test-slave-0kls"
server_key: "61c1dab7beccf15237c53f8bc8a649b6"
server_key_iv: "548a014ec6796fe5f4c8514bb7f89747"
server_key_version: "encryptionkey@0"
I20260811 01:42:17.796746 4152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:17.834856 4152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:17.839533 4152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:17.839845 4152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:17.840865 4152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:17.842425 4152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:17.842563 4152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.842720 4152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:17.842819 4152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:17.870878 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.868252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:42107)
0811 01:42:17.870338 (+ 2086us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.870488 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1912,"thread_start_us":1731,"threads_started":1}
I20260811 01:42:17.880664 4152 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:34345
I20260811 01:42:17.880726 4297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:34345 every 8 connection(s)
I20260811 01:42:17.882314 4152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:17.887703 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4152
I20260811 01:42:17.887712 4301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.885593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:43103)
0811 01:42:17.886447 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.886723 (+ 276us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":338,"threads_started":1}
W20260811 01:42:17.888635 4299 heartbeater.cc:644] Failed to heartbeat to 127.17.132.62:34739 (0 consecutive failures): Network error: Failed to ping master at 127.17.132.62:34739: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
I20260811 01:42:17.889922 4301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.889466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:36657)
0811 01:42:17.889624 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.889737 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 01:42:17.891029 4301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:17.890591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:57199)
0811 01:42:17.890779 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:17.890871 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260811 01:42:17.891419 4299 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:42:18.359166 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:18.358303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:46699)
0811 01:42:18.358809 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:18.358924 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":251,"threads_started":1}
I20260811 01:42:18.872723 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:18.871931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:35883)
0811 01:42:18.872446 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:18.872543 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":287,"threads_started":1}
W20260811 01:42:18.884773 4292 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.17.132.3:34345
I20260811 01:42:18.893115 4305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:18.892046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:55437)
0811 01:42:18.892672 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:18.892784 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":321,"threads_started":1}
I20260811 01:42:19.360939 4306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:19.360210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:54281)
0811 01:42:19.360673 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:19.360765 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":224,"threads_started":1}
I20260811 01:42:19.874830 4307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:19.873905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:33813)
0811 01:42:19.874459 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:19.874574 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":250,"threads_started":1}
I20260811 01:42:19.894866 4309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:19.894112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:59707)
0811 01:42:19.894603 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:19.894693 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260811 01:42:20.362654 4310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:20.361941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:56753)
0811 01:42:20.362393 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:20.362479 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":243,"threads_started":1}
I20260811 01:42:20.876428 4311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:20.875663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:55979)
0811 01:42:20.876099 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:20.876177 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":217,"threads_started":1}
I20260811 01:42:20.896456 4312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:20.895743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:49745)
0811 01:42:20.896202 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:20.896286 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":248,"threads_started":1}
I20260811 01:42:21.364513 4313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:21.363657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:42473)
0811 01:42:21.364204 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:21.364298 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":270,"threads_started":1}
I20260811 01:42:21.878150 4314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:21.877336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:36925)
0811 01:42:21.877895 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:21.877986 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":256,"threads_started":1}
I20260811 01:42:21.898276 4315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:21.897409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:49395)
0811 01:42:21.898028 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:21.898111 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":333,"threads_started":1}
I20260811 01:42:22.366397 4317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:22.365514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:44397)
0811 01:42:22.366093 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:22.366206 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":317,"threads_started":1}
I20260811 01:42:22.880033 4318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:22.879176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:60939)
0811 01:42:22.879708 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:22.879851 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":252,"threads_started":1}
I20260811 01:42:22.900328 4319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:22.899327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:57215)
0811 01:42:22.899908 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:22.900027 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":278,"threads_started":1}
I20260811 01:42:23.367969 4321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:23.367268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:55691)
0811 01:42:23.367714 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:23.367804 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":236,"threads_started":1}
I20260811 01:42:23.882094 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:23.881096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:53313)
0811 01:42:23.881679 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:23.881823 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":265,"threads_started":1}
I20260811 01:42:23.902153 4324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:23.901256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:50131)
0811 01:42:23.901881 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:23.901977 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":328,"threads_started":1}
I20260811 01:42:24.369761 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:24.368924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:44263)
0811 01:42:24.369432 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:24.369518 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":235,"threads_started":1}
I20260811 01:42:24.884013 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:24.883195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:55177)
0811 01:42:24.883749 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:24.883835 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":307,"threads_started":1}
I20260811 01:42:24.904297 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:24.903308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:46335)
0811 01:42:24.903948 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:24.904045 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":324,"threads_started":1}
I20260811 01:42:25.371778 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:25.370862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:37725)
0811 01:42:25.371461 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:25.371578 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":321,"threads_started":1}
I20260811 01:42:25.885890 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:25.885000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:35859)
0811 01:42:25.885549 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:25.885653 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":277,"threads_started":1}
I20260811 01:42:25.906260 4330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:25.905395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:59437)
0811 01:42:25.905989 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:25.906091 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":274,"threads_started":1}
I20260811 01:42:26.373770 4331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:26.372747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:38193)
0811 01:42:26.373448 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:26.373544 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":330,"threads_started":1}
I20260811 01:42:26.887683 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:26.886929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:52773)
0811 01:42:26.887409 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:26.887497 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":248,"threads_started":1}
I20260811 01:42:26.907960 4333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:26.907170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:52175)
0811 01:42:26.907676 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:26.907778 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":252,"threads_started":1}
I20260811 01:42:27.375725 4334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:27.374932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:45235)
0811 01:42:27.375453 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:27.375554 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":297,"threads_started":1}
I20260811 01:42:27.889554 4335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:27.888740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:38781)
0811 01:42:27.889280 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:27.889370 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":303,"threads_started":1}
I20260811 01:42:27.910008 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:27.909095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:39187)
0811 01:42:27.909615 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:27.909726 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":273,"threads_started":1}
I20260811 01:42:28.377795 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:28.376832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:51701)
0811 01:42:28.377425 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:28.377558 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":289,"threads_started":1}
I20260811 01:42:28.891566 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:28.890739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:37883)
0811 01:42:28.891287 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:28.891385 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":297,"threads_started":1}
I20260811 01:42:28.911947 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:28.911141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:46521)
0811 01:42:28.911657 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:28.911752 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":245,"threads_started":1}
I20260811 01:42:29.379573 4340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:29.378803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:54587)
0811 01:42:29.379326 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:29.379415 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":266,"threads_started":1}
I20260811 01:42:29.893455 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:29.892595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:50509)
0811 01:42:29.893119 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:29.893260 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":264,"threads_started":1}
I20260811 01:42:29.914052 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:29.913048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:55529)
0811 01:42:29.913674 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:29.913841 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":355,"threads_started":1}
I20260811 01:42:30.381392 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:30.380576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:50127)
0811 01:42:30.381099 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:30.381201 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":251,"threads_started":1}
I20260811 01:42:30.895121 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:30.894364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:42657)
0811 01:42:30.894833 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:30.894927 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":226,"threads_started":1}
I20260811 01:42:30.915987 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:30.915005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:33767)
0811 01:42:30.915554 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:30.915672 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":285,"threads_started":1}
I20260811 01:42:31.383272 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:31.382471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:44289)
0811 01:42:31.382943 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:31.383072 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":235,"threads_started":1}
I20260811 01:42:31.897157 4348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:31.896367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:51897)
0811 01:42:31.896861 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:31.896974 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":240,"threads_started":1}
I20260811 01:42:31.918370 4349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:31.917328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:44351)
0811 01:42:31.917978 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:31.918095 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":307,"threads_started":1}
I20260811 01:42:32.385110 4350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:32.384384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.2:37811)
0811 01:42:32.384813 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:32.384916 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":227,"threads_started":1}
I20260811 01:42:32.891897 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 3816
I20260811 01:42:32.899098 4352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:32.898152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.1:43023)
0811 01:42:32.898697 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:32.898838 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":286,"threads_started":1}
I20260811 01:42:32.920730 4353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:32.919639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:34739 (local address 127.17.132.3:38389)
0811 01:42:32.920301 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:32.920466 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.62:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":329,"threads_started":1}
I20260811 01:42:32.923714 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:32.894339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.17.132.1:34951)
0811 01:42:32.895116 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:32.895131 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:32.895170 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:42:32.896889 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:32.896901 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:32.897349 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:32.897684 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:32.900026 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:32.901477 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:32.903789 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:32.904560 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:32.904723 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:32.915421 (+ 10698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:32.915432 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:32.915462 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:32.915548 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:32.918818 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:32.919854 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:32.919867 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:32.919878 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:32.920167 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:32.920699 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:32.920708 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:32.920711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:32.921675 (+ 964us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:32.922054 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:32.922561 (+ 507us) server_negotiation.cc:299] Negotiation successful
0811 01:42:32.923120 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":455,"threads_started":1}
I20260811 01:42:32.925328 3994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:33.012544 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 3816
I20260811 01:42:33.034052 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4005
I20260811 01:42:33.051088 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:33.035093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37300 (local address 127.17.132.2:44113)
0811 01:42:33.035635 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:33.035650 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:33.035689 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:42:33.037267 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:33.037276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:33.037707 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:33.038126 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:33.039476 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:33.040724 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:33.041992 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:33.042622 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:33.042749 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:33.045204 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:33.045211 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:33.045225 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:33.045266 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:33.048067 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:33.048673 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:33.048679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:33.048684 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:33.048842 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:33.049290 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:33.049293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:33.049295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:33.049800 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:33.050024 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:33.050390 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 01:42:33.050813 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":263,"threads_started":1}
I20260811 01:42:33.052490 4141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:33.136826 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4005
I20260811 01:42:33.157564 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4152
I20260811 01:42:33.176123 4357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:33.158719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32952 (local address 127.17.132.3:34345)
0811 01:42:33.159315 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:33.159329 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:33.159370 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:42:33.161034 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:33.161043 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:33.161463 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:33.161844 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:33.163342 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:33.164563 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:33.165973 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:33.166634 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:33.166840 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:33.169540 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:33.169548 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:33.169564 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:33.169604 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:33.172519 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:33.173258 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:33.173265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:33.173273 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:33.173444 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:33.173896 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:33.173901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:33.173906 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:33.174487 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:33.174821 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:33.175312 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 01:42:33.175786 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":271,"threads_started":1}
I20260811 01:42:33.177654 4290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:33.263093 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4152
2026-08-11T01:42:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64984 ms)
[----------] 30 tests from SecurityITest (317128 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:42:33 dist-test-slave-0kls krb5kdc[4361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:42:33 dist-test-slave-0kls krb5kdc[4361](info): set up 2 sockets
Aug 11 01:42:33 dist-test-slave-0kls krb5kdc[4361](info): commencing operation
krb5kdc: starting...
W20260811 01:42:34.499704 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.010s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:42:34 dist-test-slave-0kls krb5kdc[4361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:42:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:42:34.830010 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42927
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:42927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:35.191716 4376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:35.192047 4376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:35.192241 4376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:35.199959 4376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:35.200103 4376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:35.200241 4376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:35.200342 4376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:35.200443 4376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:35.211169 4376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:42927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:42927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:35.212683 4376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:35.214134 4376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:35.227087 4383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:35.227200 4382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:35.227205 4385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:35.228267 4376 server_base.cc:1034] running on GCE node
I20260811 01:42:35.229058 4376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:35.230612 4376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:35.231866 4376 hybrid_clock.cc:648] HybridClock initialized: now 1786412555231810 us; error 50 us; skew 500 ppm
I20260811 01:42:35.232244 4376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:35 dist-test-slave-0kls krb5kdc[4361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412555, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:35.235566 4376 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:42:35.237133 4376 webserver.cc:460] Webserver started at http://127.17.132.62:34565/ using document root <none> and password file <none>
I20260811 01:42:35.237953 4376 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:35.238107 4376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:35.238430 4376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:35.241724 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "3ba067d2d6c44809be225115f19e9b82"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "d2fa5977ca38ffacc131f77f24c67cd7"
server_key_iv: "d75a5249bee1e87024a9bf1e139a1d6b"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.242604 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "3ba067d2d6c44809be225115f19e9b82"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "d2fa5977ca38ffacc131f77f24c67cd7"
server_key_iv: "d75a5249bee1e87024a9bf1e139a1d6b"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.248140 4376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:42:35.251757 4395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:35.253090 4376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:35.253297 4376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "3ba067d2d6c44809be225115f19e9b82"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "d2fa5977ca38ffacc131f77f24c67cd7"
server_key_iv: "d75a5249bee1e87024a9bf1e139a1d6b"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.253518 4376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:35.285326 4376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:35.289855 4376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:35.290175 4376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:35.310379 4376 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:42927
I20260811 01:42:35.310401 4453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:42927 every 8 connection(s)
I20260811 01:42:35.311888 4376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:35.313115 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4376
I20260811 01:42:35.313377 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:35.314160 17936 external_mini_cluster.cc:1428] Setting key f8d0735de012d586eb1bdd550eec56fd
I20260811 01:42:35.316196 4454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:42:35 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:35.331164 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: Bootstrap starting.
I20260811 01:42:35.334771 4454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:35.335882 4454 log.cc:824] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:35.339226 4457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:35.316485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58278 (local address 127.17.132.62:42927)
0811 01:42:35.317382 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:35.317394 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:35.317436 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:42:35.319155 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:35.319178 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:35.319574 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:35.319963 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:35.321935 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:35.323353 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:35.325331 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:35.326114 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:35.326253 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:35.331362 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:35.331375 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:35.331400 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:35.331443 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:35.334792 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:35.335586 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:35.335595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:35.335602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:35.335793 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:35.336260 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:35.336265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:35.336270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:35.336848 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:35.337171 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:35.337671 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 01:42:35.338186 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":413,"threads_started":1}
I20260811 01:42:35.339310 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: No bootstrap required, opened a new log
I20260811 01:42:35.347651 4454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } }
I20260811 01:42:35.348088 4454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:35.348222 4454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba067d2d6c44809be225115f19e9b82, State: Initialized, Role: FOLLOWER
I20260811 01:42:35.348811 4454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } }
I20260811 01:42:35.349068 4454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:35.349226 4454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:35.349407 4454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:35.351796 4454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } }
I20260811 01:42:35.352321 4454 leader_election.cc:302] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ba067d2d6c44809be225115f19e9b82; no voters:
I20260811 01:42:35.352962 4454 leader_election.cc:288] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:35.353108 4459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:35.354312 4459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba067d2d6c44809be225115f19e9b82, State: Running, Role: LEADER
I20260811 01:42:35.355003 4459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } }
I20260811 01:42:35.355321 4454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:35.357991 4461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ba067d2d6c44809be225115f19e9b82. Latest consensus state: current_term: 1 leader_uuid: "3ba067d2d6c44809be225115f19e9b82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } } }
I20260811 01:42:35.358453 4461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:35.359027 4460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ba067d2d6c44809be225115f19e9b82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ba067d2d6c44809be225115f19e9b82" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 42927 } } }
I20260811 01:42:35.359369 4470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:35.359426 4460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:35.364655 4470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:35.375123 4470 catalog_manager.cc:1347] Generated new cluster ID: 55e46bedfbb14fb48edf1900e70b00c0
I20260811 01:42:35.375268 4470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:35.383401 4470 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:35.384656 4470 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:35.391359 4470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: Generated new TSK 0
I20260811 01:42:35.392258 4470 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:42:35.486493 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:35.854873 4483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:35.855189 4483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:35.855297 4483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:35.863411 4483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:35.863539 4483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:35.863664 4483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:35.874470 4483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:35.875865 4483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:35.877210 4483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:35.891822 4492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:35.891775 4493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:35.891832 4495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:35.892760 4483 server_base.cc:1034] running on GCE node
I20260811 01:42:35.893473 4483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:35.894618 4483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:35.895889 4483 hybrid_clock.cc:648] HybridClock initialized: now 1786412555895844 us; error 54 us; skew 500 ppm
I20260811 01:42:35.896241 4483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:35 dist-test-slave-0kls krb5kdc[4361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412555, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:35.899873 4483 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:42:35.901602 4483 webserver.cc:460] Webserver started at http://127.17.132.1:38511/ using document root <none> and password file <none>
I20260811 01:42:35.902429 4483 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:35.902588 4483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:35.902953 4483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:35.906199 4483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "1fd38c777cbe4d2f8cc510b156d30a3a"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "82b43cefb3c8e9c7993778c9dc2cebd9"
server_key_iv: "b79ebbdac254bddf79d3124f0d0d02cc"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.907047 4483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "1fd38c777cbe4d2f8cc510b156d30a3a"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "82b43cefb3c8e9c7993778c9dc2cebd9"
server_key_iv: "b79ebbdac254bddf79d3124f0d0d02cc"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.912880 4483 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 01:42:35.916981 4503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:35.918605 4483 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:42:35.918815 4483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "1fd38c777cbe4d2f8cc510b156d30a3a"
format_stamp: "Formatted at 2026-08-11 01:42:35 on dist-test-slave-0kls"
server_key: "82b43cefb3c8e9c7993778c9dc2cebd9"
server_key_iv: "b79ebbdac254bddf79d3124f0d0d02cc"
server_key_version: "encryptionkey@0"
I20260811 01:42:35.919060 4483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:35.945657 4483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:35.950470 4483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:35.950796 4483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:35.951890 4483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:35.953387 4483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:35.953495 4483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:35.953662 4483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:35.953738 4483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:35.990072 4483 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:35149
I20260811 01:42:35.990129 4633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:35149 every 8 connection(s)
I20260811 01:42:35.991483 4483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:35.996124 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4483
I20260811 01:42:35.996368 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:35.997406 17936 external_mini_cluster.cc:1428] Setting key a89e16c599e2c3edb31d52e3f606c1f3
Aug 11 01:42:36 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412555, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:36.022244 4636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:35.994358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:34513 (local address 127.17.132.62:42927)
0811 01:42:35.994866 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:35.994872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:35.996047 (+ 1175us) server_negotiation.cc:407] Connection header received
0811 01:42:35.998978 (+ 2931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:35.998983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:35.999061 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:35.999184 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:36.001564 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.002922 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.005881 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.006658 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.006847 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:36.014234 (+ 7387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:36.014244 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:36.014251 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:36.014305 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:36.018083 (+ 3778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:36.019070 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:36.019079 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:36.019086 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:36.019291 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:36.019805 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:36.019813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:36.019819 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:36.020265 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:36.020446 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:36.021307 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 01:42:36.021598 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":238,"threads_started":1}
I20260811 01:42:36.023289 4637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:35.994948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42927 (local address 127.17.132.1:34513)
0811 01:42:35.995812 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:35.995880 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:35.998652 (+ 2772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:35.999413 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:35.999422 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:36.000303 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:36.001267 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:36.001301 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.003173 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.003182 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:36.005578 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:36.005603 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.007101 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.007129 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:36.007531 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:36.010266 (+ 2735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:36.010307 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:36.013860 (+ 3553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:36.018302 (+ 4442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:36.018311 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:36.018328 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:36.018897 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:36.019432 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:36.019436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:36.019438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:36.019654 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:36.020472 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:36.020480 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:36.020858 (+ 378us) client_negotiation.cc:769] Sending connection context
0811 01:42:36.021150 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 01:42:36.021603 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":285,"threads_started":1}
I20260811 01:42:36.025336 4634 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42927
I20260811 01:42:36.025739 4634 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:36.026814 4634 heartbeater.cc:511] Master 127.17.132.62:42927 requested a full tablet report, sending...
I20260811 01:42:36.029855 4415 ts_manager.cc:194] Registered new tserver with Master: 1fd38c777cbe4d2f8cc510b156d30a3a (127.17.132.1:35149)
I20260811 01:42:36.032272 4415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:34513
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:42:36.078045 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:36.445964 4641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:36.446349 4641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:36.446519 4641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:36.454172 4641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:36.454386 4641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:36.454564 4641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:36.465180 4641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:36.466648 4641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:36.468091 4641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:36.482599 4648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:36.482734 4651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:36.482704 4649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:36.483487 4641 server_base.cc:1034] running on GCE node
I20260811 01:42:36.484118 4641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:36.485147 4641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:36.486390 4641 hybrid_clock.cc:648] HybridClock initialized: now 1786412556486333 us; error 46 us; skew 500 ppm
I20260811 01:42:36.486763 4641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:36 dist-test-slave-0kls krb5kdc[4361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:36.490123 4641 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:42:36.491662 4641 webserver.cc:460] Webserver started at http://127.17.132.2:43373/ using document root <none> and password file <none>
I20260811 01:42:36.492419 4641 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:36.492574 4641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:36.492920 4641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:36.496050 4641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "096c2ea623cc4e1290ecef16c9fee864"
format_stamp: "Formatted at 2026-08-11 01:42:36 on dist-test-slave-0kls"
server_key: "12a65d593d02816cd6aba1090a70f61c"
server_key_iv: "1e132b2ff31d83a5a9c4328d1a0f95f3"
server_key_version: "encryptionkey@0"
I20260811 01:42:36.496853 4641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "096c2ea623cc4e1290ecef16c9fee864"
format_stamp: "Formatted at 2026-08-11 01:42:36 on dist-test-slave-0kls"
server_key: "12a65d593d02816cd6aba1090a70f61c"
server_key_iv: "1e132b2ff31d83a5a9c4328d1a0f95f3"
server_key_version: "encryptionkey@0"
I20260811 01:42:36.502265 4641 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:42:36.505827 4658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:36.507143 4641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:36.507321 4641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "096c2ea623cc4e1290ecef16c9fee864"
format_stamp: "Formatted at 2026-08-11 01:42:36 on dist-test-slave-0kls"
server_key: "12a65d593d02816cd6aba1090a70f61c"
server_key_iv: "1e132b2ff31d83a5a9c4328d1a0f95f3"
server_key_version: "encryptionkey@0"
I20260811 01:42:36.507539 4641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:36.535795 4641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:36.540539 4641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:36.540892 4641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:36.542034 4641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:36.543510 4641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:36.543624 4641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:36.543795 4641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:36.543871 4641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:36.580840 4641 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:38405
I20260811 01:42:36.580890 4783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:38405 every 8 connection(s)
I20260811 01:42:36.582511 4641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:36.592298 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4641
I20260811 01:42:36.592517 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:36.593019 17936 external_mini_cluster.cc:1428] Setting key 388c77731728ab46fc818b23205adc36
Aug 11 01:42:36 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:36.610423 4786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:36.586118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:36751 (local address 127.17.132.62:42927)
0811 01:42:36.586871 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:36.586879 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:36.588728 (+ 1849us) server_negotiation.cc:407] Connection header received
0811 01:42:36.590891 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:36.590895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:36.590973 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:36.591083 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:36.593300 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.594381 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.596860 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.597649 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.597864 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:36.602142 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:36.602152 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:36.602159 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:36.602208 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:36.606273 (+ 4065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:36.607339 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:36.607347 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:36.607353 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:36.607523 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:36.607980 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:36.607987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:36.607993 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:36.608410 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:36.608721 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:36.609566 (+ 845us) server_negotiation.cc:299] Negotiation successful
0811 01:42:36.609885 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":328,"threads_started":1}
I20260811 01:42:36.611361 4788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:36.586332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42927 (local address 127.17.132.2:36751)
0811 01:42:36.588490 (+ 2158us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:36.588571 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:36.590576 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:36.591422 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:36.591433 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:36.592116 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:36.592991 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:36.593024 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.594654 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.594663 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:36.596670 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:36.596686 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:36.598044 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:36.598051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:36.598297 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:36.599126 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:36.599154 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:36.601875 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:36.606452 (+ 4577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:36.606461 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:36.606478 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:36.607169 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:36.607642 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:36.607646 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:36.607648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:36.607862 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:36.608589 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:36.608600 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:36.609089 (+ 489us) client_negotiation.cc:769] Sending connection context
0811 01:42:36.609408 (+ 319us) client_negotiation.cc:240] Negotiation successful
0811 01:42:36.610036 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1832,"thread_start_us":1564,"threads_started":1}
I20260811 01:42:36.613200 4784 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42927
I20260811 01:42:36.613559 4784 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:36.614413 4784 heartbeater.cc:511] Master 127.17.132.62:42927 requested a full tablet report, sending...
I20260811 01:42:36.616086 4415 ts_manager.cc:194] Registered new tserver with Master: 096c2ea623cc4e1290ecef16c9fee864 (127.17.132.2:38405)
I20260811 01:42:36.617458 4415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:36751
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:42:36.669337 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:37.028354 4791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:37.028718 4791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:37.028890 4791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:37.036670 4791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:37.036859 4791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260811 01:42:37.036909 4634 heartbeater.cc:503] Master 127.17.132.62:42927 was elected leader, sending a full tablet report...
W20260811 01:42:37.037055 4791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:37.048180 4791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:42927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:37.049569 4791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:37.051038 4791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:37.065629 4797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:37.065722 4801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:37.066135 4799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:37.066430 4791 server_base.cc:1034] running on GCE node
I20260811 01:42:37.067112 4791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:37.068044 4791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:37.069267 4791 hybrid_clock.cc:648] HybridClock initialized: now 1786412557069218 us; error 34 us; skew 500 ppm
I20260811 01:42:37.069612 4791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:37 dist-test-slave-0kls krb5kdc[4361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412557, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:37.072981 4791 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:42:37.074641 4791 webserver.cc:460] Webserver started at http://127.17.132.3:42325/ using document root <none> and password file <none>
I20260811 01:42:37.075397 4791 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:37.075536 4791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:37.075881 4791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:37.079120 4791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646"
format_stamp: "Formatted at 2026-08-11 01:42:37 on dist-test-slave-0kls"
server_key: "bca730f7cc104847d9ac3fd81ba496d0"
server_key_iv: "ed480b4c9f5b2a78320e47497aa5002c"
server_key_version: "encryptionkey@0"
I20260811 01:42:37.079914 4791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646"
format_stamp: "Formatted at 2026-08-11 01:42:37 on dist-test-slave-0kls"
server_key: "bca730f7cc104847d9ac3fd81ba496d0"
server_key_iv: "ed480b4c9f5b2a78320e47497aa5002c"
server_key_version: "encryptionkey@0"
I20260811 01:42:37.085122 4791 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:42:37.088828 4810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:37.090253 4791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:42:37.090433 4791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646"
format_stamp: "Formatted at 2026-08-11 01:42:37 on dist-test-slave-0kls"
server_key: "bca730f7cc104847d9ac3fd81ba496d0"
server_key_iv: "ed480b4c9f5b2a78320e47497aa5002c"
server_key_version: "encryptionkey@0"
I20260811 01:42:37.090646 4791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:37.124415 4791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:37.128587 4791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:37.128907 4791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:37.129978 4791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:37.131430 4791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:37.131552 4791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:37.131712 4791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:37.131795 4791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:37.167169 4791 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:46877
I20260811 01:42:37.167222 4932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:46877 every 8 connection(s)
I20260811 01:42:37.168542 4791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:37.173827 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4791
I20260811 01:42:37.174037 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:37.174525 17936 external_mini_cluster.cc:1428] Setting key 968d1adde63a626df38615f2318ebcfa
Aug 11 01:42:37 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412557, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:37.189513 4935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.171211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40837 (local address 127.17.132.62:42927)
0811 01:42:37.171712 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.171718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.172503 (+ 785us) server_negotiation.cc:407] Connection header received
0811 01:42:37.174571 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.174577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.174685 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.174807 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:37.176615 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.177871 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.179480 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.179923 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.180057 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.183472 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:37.183477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:37.183481 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:37.183516 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:37.186438 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.187204 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.187208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.187210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.187338 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.187763 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.187766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.187768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.188035 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:37.188156 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.188861 (+ 705us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.189097 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":266,"threads_started":1}
I20260811 01:42:37.190812 4936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.171649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:42927 (local address 127.17.132.3:40837)
0811 01:42:37.172338 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.172377 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.174290 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.175102 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.175115 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.175738 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:37.176411 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.176428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.178043 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.178049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.179331 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.179343 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.180149 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.180153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.180352 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.180983 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:37.181010 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:37.183268 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:37.186572 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:37.186579 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:37.186593 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:37.187061 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:37.187466 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:37.187470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:37.187472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:37.187666 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:37.188143 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:37.188150 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:37.188492 (+ 342us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.188776 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.189355 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":286,"threads_started":1}
I20260811 01:42:37.192133 4933 heartbeater.cc:347] Connected to a master server at 127.17.132.62:42927
I20260811 01:42:37.192472 4933 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:37.193251 4933 heartbeater.cc:511] Master 127.17.132.62:42927 requested a full tablet report, sending...
I20260811 01:42:37.194864 4415 ts_manager.cc:194] Registered new tserver with Master: 8bb20aadd5b74ca7bd1cc3c32a7e3646 (127.17.132.3:46877)
I20260811 01:42:37.195791 4415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:40837
I20260811 01:42:37.202996 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:37.220660 4935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.207895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58294 (local address 127.17.132.62:42927)
0811 01:42:37.208089 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.208094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.208588 (+ 494us) server_negotiation.cc:407] Connection header received
0811 01:42:37.208737 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.208740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.208805 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.208886 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:37.210497 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.211328 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.212770 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.213177 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.213275 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.215831 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:37.215836 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:37.215839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:37.215873 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:37.218375 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.219010 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.219014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.219016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.219130 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.219447 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.219450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.219452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.219785 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:37.219962 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.220264 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.220434 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:42:37.224926 4415 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:37.231868 4415 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:37.255539 4951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.244412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35149 (local address 127.0.0.1:47210)
0811 01:42:37.245885 (+ 1473us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.245930 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.246207 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.248173 (+ 1966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.248176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.248205 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:37.248609 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.248623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250828 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.250833 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.252672 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.252684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.254483 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.254489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.254701 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.254751 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.254891 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.255089 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1228,"mutex_wait_us":69,"thread_start_us":1098,"threads_started":1}
I20260811 01:42:37.255570 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.244725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47210 (local address 127.17.132.1:35149)
0811 01:42:37.245503 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.245514 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.246045 (+ 531us) server_negotiation.cc:407] Connection header received
0811 01:42:37.247523 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.247530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.247697 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.247881 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:37.248830 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250615 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.252833 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.253975 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.254126 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.254358 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.254962 (+ 604us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.255181 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":361,"threads_started":1}
I20260811 01:42:37.256480 4953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.246313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:46877 (local address 127.0.0.1:40898)
0811 01:42:37.247275 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.247298 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.247434 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.248664 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.248668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.248710 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:37.249128 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.249140 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250987 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.250991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.253491 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.253504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.255597 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.255604 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.255790 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.255818 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.255902 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.256030 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":103,"thread_start_us":298,"threads_started":1}
I20260811 01:42:37.256937 4954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.245537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54862 (local address 127.17.132.2:38405)
0811 01:42:37.246068 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.246080 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.247103 (+ 1023us) server_negotiation.cc:407] Connection header received
0811 01:42:37.247425 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.247436 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.247710 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.247877 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:37.249008 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250593 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.254419 (+ 3826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.255679 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.255858 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.256066 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.256472 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.256639 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":284,"threads_started":1}
I20260811 01:42:37.257798 4955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.244990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:38405 (local address 127.0.0.1:54862)
0811 01:42:37.246972 (+ 1982us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.246990 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.247218 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.248074 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.248082 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.248115 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:37.248721 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.248737 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250741 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.250746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.254264 (+ 3518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.254276 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.255967 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.255974 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.256201 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.256240 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.257181 (+ 941us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.257319 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1804,"mutex_wait_us":154,"thread_start_us":1933,"threads_started":1}
I20260811 01:42:37.256978 4957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.246687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.17.132.3:46877)
0811 01:42:37.248072 (+ 1385us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.248080 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.248109 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:42:37.248201 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.248210 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.248434 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.248649 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:37.249319 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.250842 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.253661 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.255089 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.255212 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.255425 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.256418 (+ 993us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.256601 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1219,"thread_start_us":1053,"threads_started":1}
I20260811 01:42:37.260180 4558 tablet_service.cc:1467] Processing CreateTablet for tablet 48b5bb97b080415998135b65a5ded082 (DEFAULT_TABLE table=test-table [id=6977f506bbe3411d857f11f9330b21fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:37.261018 4862 tablet_service.cc:1467] Processing CreateTablet for tablet 48b5bb97b080415998135b65a5ded082 (DEFAULT_TABLE table=test-table [id=6977f506bbe3411d857f11f9330b21fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:37.261817 4558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48b5bb97b080415998135b65a5ded082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:37.262274 4862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48b5bb97b080415998135b65a5ded082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:37.262145 4709 tablet_service.cc:1467] Processing CreateTablet for tablet 48b5bb97b080415998135b65a5ded082 (DEFAULT_TABLE table=test-table [id=6977f506bbe3411d857f11f9330b21fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:37.263474 4709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48b5bb97b080415998135b65a5ded082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:37.273895 4958 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Bootstrap starting.
I20260811 01:42:37.276669 4959 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Bootstrap starting.
I20260811 01:42:37.278330 4958 tablet_bootstrap.cc:654] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:37.279141 4960 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Bootstrap starting.
I20260811 01:42:37.280314 4958 log.cc:824] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:37.280408 4959 tablet_bootstrap.cc:654] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:37.281586 4959 log.cc:824] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:37.282343 4960 tablet_bootstrap.cc:654] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:37.283437 4960 log.cc:824] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:37.283802 4958 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: No bootstrap required, opened a new log
I20260811 01:42:37.284111 4958 ts_tablet_manager.cc:1397] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 01:42:37.284758 4959 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: No bootstrap required, opened a new log
I20260811 01:42:37.285028 4959 ts_tablet_manager.cc:1397] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 01:42:37.286077 4960 tablet_bootstrap.cc:492] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: No bootstrap required, opened a new log
I20260811 01:42:37.286641 4960 ts_tablet_manager.cc:1397] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 01:42:37.294003 4960 raft_consensus.cc:348] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.294469 4960 raft_consensus.cc:374] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:37.294574 4960 raft_consensus.cc:729] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096c2ea623cc4e1290ecef16c9fee864, State: Initialized, Role: FOLLOWER
I20260811 01:42:37.295219 4960 consensus_queue.cc:260] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.296001 4959 raft_consensus.cc:348] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.295675 4958 raft_consensus.cc:348] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.296370 4784 heartbeater.cc:503] Master 127.17.132.62:42927 was elected leader, sending a full tablet report...
I20260811 01:42:37.296409 4959 raft_consensus.cc:374] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:37.296525 4958 raft_consensus.cc:374] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:37.296523 4959 raft_consensus.cc:729] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd38c777cbe4d2f8cc510b156d30a3a, State: Initialized, Role: FOLLOWER
I20260811 01:42:37.296613 4958 raft_consensus.cc:729] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bb20aadd5b74ca7bd1cc3c32a7e3646, State: Initialized, Role: FOLLOWER
I20260811 01:42:37.297086 4960 ts_tablet_manager.cc:1428] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:42:37.297228 4959 consensus_queue.cc:260] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.297238 4958 consensus_queue.cc:260] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.301589 4933 heartbeater.cc:503] Master 127.17.132.62:42927 was elected leader, sending a full tablet report...
I20260811 01:42:37.302215 4959 ts_tablet_manager.cc:1428] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Time spent starting tablet: real 0.017s user 0.019s sys 0.000s
I20260811 01:42:37.303421 4958 ts_tablet_manager.cc:1428] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Time spent starting tablet: real 0.019s user 0.019s sys 0.000s
W20260811 01:42:37.334718 4785 tablet.cc:2369] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:37.373000 4967 raft_consensus.cc:482] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:37.373327 4967 raft_consensus.cc:504] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.375119 4967 leader_election.cc:288] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bb20aadd5b74ca7bd1cc3c32a7e3646 (127.17.132.3:46877), 096c2ea623cc4e1290ecef16c9fee864 (127.17.132.2:38405)
I20260811 01:42:37.382280 4957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.375499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:56155 (local address 127.17.132.3:46877)
0811 01:42:37.375739 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.375747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.376511 (+ 764us) server_negotiation.cc:407] Connection header received
0811 01:42:37.376745 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.376754 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.376836 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.376904 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:37.377632 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.378470 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.380497 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.381253 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.381443 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.381537 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.381853 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.381997 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:42:37.382313 4954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.375762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:33781 (local address 127.17.132.2:38405)
0811 01:42:37.376008 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.376013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.376652 (+ 639us) server_negotiation.cc:407] Connection header received
0811 01:42:37.376827 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.376831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.376923 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.377019 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:37.377829 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.378574 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.380430 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.381256 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.381456 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.381538 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.381891 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.382026 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 01:42:37.382653 4969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.375649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:38405 (local address 127.17.132.1:33781)
0811 01:42:37.376511 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.376531 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.376682 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.377059 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.377071 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.377091 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:37.377591 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.377607 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.378716 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.378720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.380271 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.380283 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.381571 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.381580 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.381703 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.381726 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.381862 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.382012 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":12,"thread_start_us":540,"threads_started":1}
I20260811 01:42:37.382777 4968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.375284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:46877 (local address 127.17.132.1:56155)
0811 01:42:37.376360 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:37.376386 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:37.376546 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:37.376961 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:37.376969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:37.376999 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:37.377452 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.377463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.378614 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.378621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.380309 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:37.380322 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.381506 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.381512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:37.381673 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.381705 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 01:42:37.381830 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:42:37.382006 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":111,"spinlock_wait_cycles":22400,"thread_start_us":666,"threads_started":1}
I20260811 01:42:37.383683 4883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48b5bb97b080415998135b65a5ded082" candidate_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" is_pre_election: true
I20260811 01:42:37.383711 4733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48b5bb97b080415998135b65a5ded082" candidate_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096c2ea623cc4e1290ecef16c9fee864" is_pre_election: true
I20260811 01:42:37.384200 4733 raft_consensus.cc:2454] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd38c777cbe4d2f8cc510b156d30a3a in term 0.
I20260811 01:42:37.384209 4883 raft_consensus.cc:2454] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fd38c777cbe4d2f8cc510b156d30a3a in term 0.
I20260811 01:42:37.384891 4505 leader_election.cc:302] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 096c2ea623cc4e1290ecef16c9fee864, 1fd38c777cbe4d2f8cc510b156d30a3a, 8bb20aadd5b74ca7bd1cc3c32a7e3646; no voters:
I20260811 01:42:37.385322 4967 raft_consensus.cc:2781] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:37.385474 4967 raft_consensus.cc:482] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:37.385597 4967 raft_consensus.cc:3037] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:37.388236 4967 raft_consensus.cc:504] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.388859 4967 leader_election.cc:288] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [CANDIDATE]: Term 1 election: Requested vote from peers 8bb20aadd5b74ca7bd1cc3c32a7e3646 (127.17.132.3:46877), 096c2ea623cc4e1290ecef16c9fee864 (127.17.132.2:38405)
I20260811 01:42:37.389447 4883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48b5bb97b080415998135b65a5ded082" candidate_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646"
I20260811 01:42:37.389447 4733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48b5bb97b080415998135b65a5ded082" candidate_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096c2ea623cc4e1290ecef16c9fee864"
I20260811 01:42:37.389688 4733 raft_consensus.cc:3037] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:37.389688 4883 raft_consensus.cc:3037] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:37.393136 4733 raft_consensus.cc:2454] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd38c777cbe4d2f8cc510b156d30a3a in term 1.
I20260811 01:42:37.393131 4883 raft_consensus.cc:2454] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fd38c777cbe4d2f8cc510b156d30a3a in term 1.
I20260811 01:42:37.393649 4507 leader_election.cc:302] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fd38c777cbe4d2f8cc510b156d30a3a, 8bb20aadd5b74ca7bd1cc3c32a7e3646; no voters:
I20260811 01:42:37.394070 4967 raft_consensus.cc:2781] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:37.394575 4967 raft_consensus.cc:686] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 1 LEADER]: Becoming Leader. State: Replica: 1fd38c777cbe4d2f8cc510b156d30a3a, State: Running, Role: LEADER
I20260811 01:42:37.395203 4967 consensus_queue.cc:237] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } }
I20260811 01:42:37.399830 4414 catalog_manager.cc:5495] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fd38c777cbe4d2f8cc510b156d30a3a (127.17.132.1). New cstate: current_term: 1 leader_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fd38c777cbe4d2f8cc510b156d30a3a" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 } health_report { overall_health: UNKNOWN } } }
W20260811 01:42:37.420322 4934 tablet.cc:2369] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:37.451220 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.446092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47226 (local address 127.17.132.1:35149)
0811 01:42:37.446295 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.446299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.446315 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:42:37.446407 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.446410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.446487 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.446614 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:37.446943 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.447675 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.449116 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.449522 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.449619 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.450139 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:37.450641 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:37.450771 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.450842 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.450911 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:42:37.459941 4883 raft_consensus.cc:1261] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 1 FOLLOWER]: Refusing update from remote peer 1fd38c777cbe4d2f8cc510b156d30a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:37.459941 4733 raft_consensus.cc:1261] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 1 FOLLOWER]: Refusing update from remote peer 1fd38c777cbe4d2f8cc510b156d30a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:37.460994 4970 consensus_queue.cc:1035] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bb20aadd5b74ca7bd1cc3c32a7e3646" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 46877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:37.461319 4967 consensus_queue.cc:1035] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "096c2ea623cc4e1290ecef16c9fee864" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 38405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:37.473330 4973 mvcc.cc:205] Tried to move back new op lower bound from 7317145835344044032 to 7317145835094593536. Current Snapshot: MvccSnapshot[applied={T|T < 7317145835344044032}]
I20260811 01:42:37.490499 4415 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:37.490859 4415 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:37.503123 4415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ba067d2d6c44809be225115f19e9b82: Sending DeleteTablet for 3 replicas of tablet 48b5bb97b080415998135b65a5ded082
I20260811 01:42:37.504640 4862 tablet_service.cc:1514] Processing DeleteTablet for tablet 48b5bb97b080415998135b65a5ded082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:40898
I20260811 01:42:37.504706 4709 tablet_service.cc:1514] Processing DeleteTablet for tablet 48b5bb97b080415998135b65a5ded082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:54862
I20260811 01:42:37.505447 4558 tablet_service.cc:1514] Processing DeleteTablet for tablet 48b5bb97b080415998135b65a5ded082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:37 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47210
I20260811 01:42:37.508627 4985 tablet_replica.cc:330] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: stopping tablet replica
I20260811 01:42:37.509236 4985 raft_consensus.cc:2229] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:37.510114 4985 raft_consensus.cc:2258] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:37.510995 4983 tablet_replica.cc:330] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: stopping tablet replica
I20260811 01:42:37.511281 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4483
I20260811 01:42:37.511525 4983 raft_consensus.cc:2229] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:37.512144 4983 raft_consensus.cc:2258] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:37.512749 4985 ts_tablet_manager.cc:1905] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:37.513128 4984 tablet_replica.cc:330] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: stopping tablet replica
I20260811 01:42:37.513640 4984 raft_consensus.cc:2229] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:37.514271 4984 raft_consensus.cc:2258] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:37.516644 4984 ts_tablet_manager.cc:1905] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:37.521564 4985 ts_tablet_manager.cc:1918] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:37.521756 4985 log.cc:1196] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/48b5bb97b080415998135b65a5ded082
I20260811 01:42:37.522406 4985 ts_tablet_manager.cc:1939] T 48b5bb97b080415998135b65a5ded082 P 1fd38c777cbe4d2f8cc510b156d30a3a: Deleting consensus metadata
I20260811 01:42:37.523957 4984 ts_tablet_manager.cc:1918] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:37.524128 4984 log.cc:1196] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/48b5bb97b080415998135b65a5ded082
I20260811 01:42:37.524693 4984 ts_tablet_manager.cc:1939] T 48b5bb97b080415998135b65a5ded082 P 096c2ea623cc4e1290ecef16c9fee864: Deleting consensus metadata
I20260811 01:42:37.525024 4983 ts_tablet_manager.cc:1905] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 01:42:37 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:42:37.526674 4397 catalog_manager.cc:4841] TS 096c2ea623cc4e1290ecef16c9fee864 (127.17.132.2:38405): tablet 48b5bb97b080415998135b65a5ded082 (table test-table [id=6977f506bbe3411d857f11f9330b21fb]) successfully deleted
I20260811 01:42:37.532521 4983 ts_tablet_manager.cc:1918] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:37.532716 4983 log.cc:1196] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/48b5bb97b080415998135b65a5ded082
I20260811 01:42:37.533324 4983 ts_tablet_manager.cc:1939] T 48b5bb97b080415998135b65a5ded082 P 8bb20aadd5b74ca7bd1cc3c32a7e3646: Deleting consensus metadata
I20260811 01:42:37.534327 4399 catalog_manager.cc:4841] TS 1fd38c777cbe4d2f8cc510b156d30a3a (127.17.132.1:35149): tablet 48b5bb97b080415998135b65a5ded082 (table test-table [id=6977f506bbe3411d857f11f9330b21fb]) successfully deleted
I20260811 01:42:37.535216 4399 catalog_manager.cc:4841] TS 8bb20aadd5b74ca7bd1cc3c32a7e3646 (127.17.132.3:46877): tablet 48b5bb97b080415998135b65a5ded082 (table test-table [id=6977f506bbe3411d857f11f9330b21fb]) successfully deleted
I20260811 01:42:37.536239 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.512522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.17.132.1:35149)
0811 01:42:37.512715 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.512723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.515150 (+ 2427us) server_negotiation.cc:407] Connection header received
0811 01:42:37.515374 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.515381 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.515509 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.515618 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:37.517508 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.518747 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.520796 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.521551 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.521660 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.528005 (+ 6345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:37.528020 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:37.528037 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:37.528086 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:37.532500 (+ 4414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.533520 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.533534 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.533538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.533738 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.534308 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.534313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.534316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.534823 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:37.535118 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.535624 (+ 506us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.535890 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:42:37.536949 4629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:37.639590 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4483
I20260811 01:42:37.661921 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4641
Aug 11 01:42:37 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:42:37.676931 4954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.662837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.17.132.2:38405)
0811 01:42:37.663012 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.663016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.663035 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:42:37.663124 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.663127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.663199 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.663283 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:37.664506 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.665269 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.666623 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.667022 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.667113 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.671407 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:37.671424 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:37.671440 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:37.671476 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:37.674345 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.675001 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.675009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.675011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.675132 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.675498 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.675501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.675503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.675885 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:37.676104 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.676382 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.676544 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:42:37.677719 4779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:37.769268 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4641
I20260811 01:42:37.790728 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4791
Aug 11 01:42:37 dist-test-slave-0kls krb5kdc[4361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:42:37.808810 4957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:37.791501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.17.132.3:46877)
0811 01:42:37.791686 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:37.791691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:37.791711 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:42:37.791866 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:37.791870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:37.791936 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:37.792023 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:37.793319 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.794233 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.795598 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:37.795997 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:37.796092 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:37.801412 (+ 5320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:37.801435 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:37.801456 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:37.801528 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:37.805374 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.806424 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.806437 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.806441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.806644 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:37.807116 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:37.807121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:37.807125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:37.807508 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:37.807842 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:37.808228 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 01:42:37.808461 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:42:37.809505 4928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:37.920738 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4791
I20260811 01:42:37.942066 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4376
I20260811 01:42:37.943285 4448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:38.058482 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4376
2026-08-11T01:42:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4798 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T01:42:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:38Z Disabled control of system clock
I20260811 01:42:38.156226 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40803
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:38.512665 4995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:38.512990 4995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:38.513177 4995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:38.520823 4995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:38.520946 4995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:38.521027 4995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:38.521139 4995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:38.521236 4995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:38.530875 4995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40803
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:38.532267 4995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:38.534170 4995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:38.547379 5000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:38.547451 5001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:38.547456 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:38.548352 4995 server_base.cc:1034] running on GCE node
I20260811 01:42:38.549228 4995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:38.550863 4995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:38.552102 4995 hybrid_clock.cc:648] HybridClock initialized: now 1786412558552054 us; error 44 us; skew 500 ppm
I20260811 01:42:38.552506 4995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:38.560985 4995 webserver.cc:460] Webserver started at http://127.17.132.62:42149/ using document root <none> and password file <none>
I20260811 01:42:38.561838 4995 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:38.561996 4995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:38.562356 4995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:38.565428 4995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "980df17f9b6f46b8a922d66110f1d420"
format_stamp: "Formatted at 2026-08-11 01:42:38 on dist-test-slave-0kls"
server_key: "bf784fa6ddf29234010beb4a123556a9"
server_key_iv: "4f1c2b58d1a2fb08adafb3b56d51459d"
server_key_version: "encryptionkey@0"
I20260811 01:42:38.566339 4995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "980df17f9b6f46b8a922d66110f1d420"
format_stamp: "Formatted at 2026-08-11 01:42:38 on dist-test-slave-0kls"
server_key: "bf784fa6ddf29234010beb4a123556a9"
server_key_iv: "4f1c2b58d1a2fb08adafb3b56d51459d"
server_key_version: "encryptionkey@0"
I20260811 01:42:38.571725 4995 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:42:38.575455 5009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:38.576905 4995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:42:38.577131 4995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "980df17f9b6f46b8a922d66110f1d420"
format_stamp: "Formatted at 2026-08-11 01:42:38 on dist-test-slave-0kls"
server_key: "bf784fa6ddf29234010beb4a123556a9"
server_key_iv: "4f1c2b58d1a2fb08adafb3b56d51459d"
server_key_version: "encryptionkey@0"
I20260811 01:42:38.577371 4995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:38.592862 4995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:38.593956 4995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:38.594303 4995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:38.616027 4995 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:40803
I20260811 01:42:38.616080 5066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:40803 every 8 connection(s)
I20260811 01:42:38.617537 4995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:38.621770 5067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:38.622211 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 4995
I20260811 01:42:38.622386 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:38.622865 17936 external_mini_cluster.cc:1428] Setting key 9552658cf7d8b81e2b21c160381f7c83
I20260811 01:42:38.638715 5067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: Bootstrap starting.
I20260811 01:42:38.641016 5071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:38.624916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40864 (local address 127.17.132.62:40803)
0811 01:42:38.626286 (+ 1370us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:38.626303 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:38.626368 (+ 65us) server_negotiation.cc:407] Connection header received
0811 01:42:38.629517 (+ 3149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:38.629553 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:38.630353 (+ 800us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:38.630872 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:38.631490 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:38.633462 (+ 1972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:38.635250 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:38.636461 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:38.636648 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:38.637922 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:38.637933 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:38.637954 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:38.638749 (+ 795us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:38.638859 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:38.638889 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:38.639005 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:38.639236 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 01:42:38.639602 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":436,"threads_started":1}
I20260811 01:42:38.642799 5067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:38.643936 5067 log.cc:824] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:38.646826 5067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: No bootstrap required, opened a new log
I20260811 01:42:38.654300 5067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } }
I20260811 01:42:38.654716 5067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:38.654830 5067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 980df17f9b6f46b8a922d66110f1d420, State: Initialized, Role: FOLLOWER
I20260811 01:42:38.655507 5067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } }
I20260811 01:42:38.655779 5067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:38.655931 5067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:38.656114 5067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:38.658442 5067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } }
I20260811 01:42:38.658963 5067 leader_election.cc:302] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 980df17f9b6f46b8a922d66110f1d420; no voters:
I20260811 01:42:38.659559 5067 leader_election.cc:288] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:38.659729 5073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:38.660498 5073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [term 1 LEADER]: Becoming Leader. State: Replica: 980df17f9b6f46b8a922d66110f1d420, State: Running, Role: LEADER
I20260811 01:42:38.661082 5073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } }
I20260811 01:42:38.661931 5067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:38.664096 5074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "980df17f9b6f46b8a922d66110f1d420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } } }
I20260811 01:42:38.664222 5075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 980df17f9b6f46b8a922d66110f1d420. Latest consensus state: current_term: 1 leader_uuid: "980df17f9b6f46b8a922d66110f1d420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "980df17f9b6f46b8a922d66110f1d420" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40803 } } }
I20260811 01:42:38.664527 5074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:38.665287 5075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:38.666234 5079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:38.672638 5079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:38.681622 5079 catalog_manager.cc:1347] Generated new cluster ID: 5295eb8c35ff457882b18783bb25e9e7
I20260811 01:42:38.681746 5079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:38.697158 5079 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:38.698859 5079 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:38.714736 5079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: Generated new TSK 0
I20260811 01:42:38.715626 5079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:42:38.726979 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--builtin_ntp_servers=127.17.132.20:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:39.084648 5096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:39.084997 5096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:39.085171 5096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:39.092970 5096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:39.093142 5096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:39.093333 5096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:39.102982 5096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:39.104365 5096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:39.106302 5096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:39.120194 5103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:39.120397 5105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:39.120165 5102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:39.121037 5096 server_base.cc:1034] running on GCE node
I20260811 01:42:39.121690 5096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:39.122668 5096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:39.123915 5096 hybrid_clock.cc:648] HybridClock initialized: now 1786412559123868 us; error 40 us; skew 500 ppm
I20260811 01:42:39.124254 5096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:39.126683 5096 webserver.cc:460] Webserver started at http://127.17.132.1:40469/ using document root <none> and password file <none>
I20260811 01:42:39.127388 5096 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:39.127524 5096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:39.127856 5096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:39.130859 5096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "bd45781870e048c2aed97b7cd12f7130"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "7bf9d0a47aef2e7684c2efeeb63e26cb"
server_key_iv: "5e87cab8536d90de78de82e9094eee49"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.131644 5096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "bd45781870e048c2aed97b7cd12f7130"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "7bf9d0a47aef2e7684c2efeeb63e26cb"
server_key_iv: "5e87cab8536d90de78de82e9094eee49"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.137099 5096 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 01:42:39.140818 5111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.142315 5096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:42:39.142453 5096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "bd45781870e048c2aed97b7cd12f7130"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "7bf9d0a47aef2e7684c2efeeb63e26cb"
server_key_iv: "5e87cab8536d90de78de82e9094eee49"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.142647 5096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:39.153852 5096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:39.154668 5096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:39.154956 5096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:39.155939 5096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:39.157425 5096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:39.157513 5096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.157606 5096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:39.157670 5096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.192425 5096 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:35295
I20260811 01:42:39.192438 5238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:35295 every 8 connection(s)
I20260811 01:42:39.193928 5096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:39.201670 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5096
I20260811 01:42:39.201880 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:39.202344 17936 external_mini_cluster.cc:1428] Setting key 51d3fa8e50c5045caee8c5c49c140ce1
I20260811 01:42:39.205001 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--builtin_ntp_servers=127.17.132.20:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:39.206565 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:39.196597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:49915 (local address 127.17.132.62:40803)
0811 01:42:39.197052 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:39.197057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:39.198345 (+ 1288us) server_negotiation.cc:407] Connection header received
0811 01:42:39.200158 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:39.200164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:39.200254 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:39.200372 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:39.201410 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.202255 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.203773 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.204200 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.204330 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:39.205702 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:39.205706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:39.205710 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:39.205726 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:39.205764 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:39.205775 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:39.205896 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:39.206125 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 01:42:39.206222 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":238,"threads_started":1}
I20260811 01:42:39.207557 5242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:39.197225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40803 (local address 127.17.132.1:49915)
0811 01:42:39.198186 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:39.198229 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:39.199880 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:39.200602 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:39.200611 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:39.200700 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:39.201240 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:39.201255 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.202408 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.202412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:39.203626 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:39.203638 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.204432 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.204441 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:39.204681 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:39.205376 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:39.205379 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:39.205421 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:39.205493 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:39.205897 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:39.205912 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:39.205921 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:42:39.206114 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 01:42:39.206497 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":292,"threads_started":1}
I20260811 01:42:39.209124 5239 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40803
I20260811 01:42:39.209427 5239 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:39.210208 5239 heartbeater.cc:511] Master 127.17.132.62:40803 requested a full tablet report, sending...
I20260811 01:42:39.212504 5026 ts_manager.cc:194] Registered new tserver with Master: bd45781870e048c2aed97b7cd12f7130 (127.17.132.1:35295)
I20260811 01:42:39.214788 5026 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.1:49915
W20260811 01:42:39.552860 5243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:39.553169 5243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:39.553267 5243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:39.560751 5243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:39.560860 5243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:39.560968 5243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:39.570564 5243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:39.571899 5243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:39.573663 5243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:39.587376 5252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:39.587472 5248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:39.587462 5249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:39.588209 5243 server_base.cc:1034] running on GCE node
I20260811 01:42:39.588893 5243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:39.589970 5243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:39.591313 5243 hybrid_clock.cc:648] HybridClock initialized: now 1786412559591254 us; error 48 us; skew 500 ppm
I20260811 01:42:39.591717 5243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:39.594465 5243 webserver.cc:460] Webserver started at http://127.17.132.2:36031/ using document root <none> and password file <none>
I20260811 01:42:39.595257 5243 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:39.595448 5243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:39.595947 5243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:39.600317 5243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "57b75116ba44411b88cf405e2e9f2ec0"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "e440ba65a356bf7c659327c0f5346bd7"
server_key_iv: "fae84dc2f4831d9d931e862fed79eb5a"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.601279 5243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "57b75116ba44411b88cf405e2e9f2ec0"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "e440ba65a356bf7c659327c0f5346bd7"
server_key_iv: "fae84dc2f4831d9d931e862fed79eb5a"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.607625 5243 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:42:39.611919 5260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.613869 5243 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 01:42:39.614084 5243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "57b75116ba44411b88cf405e2e9f2ec0"
format_stamp: "Formatted at 2026-08-11 01:42:39 on dist-test-slave-0kls"
server_key: "e440ba65a356bf7c659327c0f5346bd7"
server_key_iv: "fae84dc2f4831d9d931e862fed79eb5a"
server_key_version: "encryptionkey@0"
I20260811 01:42:39.614357 5243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:39.631284 5243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:39.632440 5243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:39.632833 5243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:39.634274 5243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:39.635979 5243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:39.636106 5243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.636271 5243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:39.636368 5243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:39.672235 5243 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:35197
I20260811 01:42:39.672297 5387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:35197 every 8 connection(s)
I20260811 01:42:39.673630 5243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:39.678676 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5243
I20260811 01:42:39.678867 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:39.679333 17936 external_mini_cluster.cc:1428] Setting key ce6a904f897c95564fb90deadf1e41fd
I20260811 01:42:39.686360 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--builtin_ntp_servers=127.17.132.20:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:39.686407 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:39.676252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:40821 (local address 127.17.132.62:40803)
0811 01:42:39.676476 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:39.676482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:39.677842 (+ 1360us) server_negotiation.cc:407] Connection header received
0811 01:42:39.679770 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:39.679775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:39.679869 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:39.679980 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:39.681091 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.681961 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.683579 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.683976 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.684115 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:39.685535 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:39.685540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:39.685543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:39.685560 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:39.685591 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:39.685602 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:39.685705 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:39.685983 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:42:39.686085 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:42:39.687438 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:39.676791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40803 (local address 127.17.132.2:40821)
0811 01:42:39.677663 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:39.677697 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:39.679498 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:39.680228 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:39.680235 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:39.680317 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:39.680925 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:39.680944 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.682107 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.682117 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:39.683422 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:39.683435 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:39.684205 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:39.684214 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:39.684502 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:39.685224 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:39.685226 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:39.685265 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:39.685339 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:39.685714 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:39.685726 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:39.685735 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:42:39.685972 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 01:42:39.686359 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":291,"threads_started":1}
I20260811 01:42:39.688944 5388 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40803
I20260811 01:42:39.689266 5388 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:39.690093 5388 heartbeater.cc:511] Master 127.17.132.62:40803 requested a full tablet report, sending...
I20260811 01:42:39.691610 5026 ts_manager.cc:194] Registered new tserver with Master: 57b75116ba44411b88cf405e2e9f2ec0 (127.17.132.2:35197)
I20260811 01:42:39.692859 5026 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.2:40821
W20260811 01:42:40.039944 5391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:40.040323 5391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:40.040498 5391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:40.048326 5391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:40.048471 5391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:40.048661 5391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:40.057977 5391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:40803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:40.059464 5391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:40.061362 5391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:40.075524 5396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:40.075589 5397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:40.075791 5399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:40.076587 5391 server_base.cc:1034] running on GCE node
I20260811 01:42:40.077260 5391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:40.078402 5391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:40.079646 5391 hybrid_clock.cc:648] HybridClock initialized: now 1786412560079604 us; error 54 us; skew 500 ppm
I20260811 01:42:40.079998 5391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:40.082612 5391 webserver.cc:460] Webserver started at http://127.17.132.3:33709/ using document root <none> and password file <none>
I20260811 01:42:40.083369 5391 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:40.083508 5391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:40.083847 5391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:40.087009 5391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "7b7bc631cb4d4063887841ed5391f8ff"
format_stamp: "Formatted at 2026-08-11 01:42:40 on dist-test-slave-0kls"
server_key: "152e1e5b0a7b8e1acc4a989bef8e9897"
server_key_iv: "4cea92d20107cba9d467212c3162e627"
server_key_version: "encryptionkey@0"
I20260811 01:42:40.087875 5391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "7b7bc631cb4d4063887841ed5391f8ff"
format_stamp: "Formatted at 2026-08-11 01:42:40 on dist-test-slave-0kls"
server_key: "152e1e5b0a7b8e1acc4a989bef8e9897"
server_key_iv: "4cea92d20107cba9d467212c3162e627"
server_key_version: "encryptionkey@0"
I20260811 01:42:40.093670 5391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:42:40.097677 5406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:40.099128 5391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:42:40.099318 5391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "7b7bc631cb4d4063887841ed5391f8ff"
format_stamp: "Formatted at 2026-08-11 01:42:40 on dist-test-slave-0kls"
server_key: "152e1e5b0a7b8e1acc4a989bef8e9897"
server_key_iv: "4cea92d20107cba9d467212c3162e627"
server_key_version: "encryptionkey@0"
I20260811 01:42:40.099548 5391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:40.113298 5391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:40.114266 5391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:40.114588 5391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:40.115592 5391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:40.117267 5391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:40.117417 5391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:40.117549 5391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:40.117636 5391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:40.152618 5391 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:44627
I20260811 01:42:40.152669 5529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:44627 every 8 connection(s)
I20260811 01:42:40.154183 5391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:40.158833 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5391
I20260811 01:42:40.159034 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:40.159621 17936 external_mini_cluster.cc:1428] Setting key 3f0434712051a430e660b2b1c5a4b2bd
I20260811 01:42:40.168236 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.156963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:52299 (local address 127.17.132.62:40803)
0811 01:42:40.157166 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.157171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.158886 (+ 1715us) server_negotiation.cc:407] Connection header received
0811 01:42:40.161168 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.161173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.161241 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.161316 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:40.162776 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.163641 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.165223 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.165644 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.165822 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.167310 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:40.167316 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:40.167327 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:40.167346 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:40.167377 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:40.167389 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:40.167515 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.167758 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.167862 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:42:40.169229 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.157518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:40803 (local address 127.17.132.3:52299)
0811 01:42:40.158703 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.158751 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.160903 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.161580 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.161589 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.161678 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:40.162589 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.162617 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.163813 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.163819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.165063 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.165075 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.165927 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.165934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.166176 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.166965 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:40.166969 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:40.167023 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:40.167106 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:40.167516 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:40.167529 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:40.167540 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.167731 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.168132 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":451,"threads_started":1}
I20260811 01:42:40.170670 5530 heartbeater.cc:347] Connected to a master server at 127.17.132.62:40803
I20260811 01:42:40.170965 5530 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:40.171689 5530 heartbeater.cc:511] Master 127.17.132.62:40803 requested a full tablet report, sending...
I20260811 01:42:40.173115 5026 ts_manager.cc:194] Registered new tserver with Master: 7b7bc631cb4d4063887841ed5391f8ff (127.17.132.3:44627)
I20260811 01:42:40.174080 5026 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.3:52299
I20260811 01:42:40.175824 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:40.186826 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.180754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40880 (local address 127.17.132.62:40803)
0811 01:42:40.180999 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.181007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.181409 (+ 402us) server_negotiation.cc:407] Connection header received
0811 01:42:40.181550 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.181554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.181699 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.181834 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:40.182410 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.183137 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.184500 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.184940 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.185037 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.186124 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:40.186129 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:40.186132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:40.186151 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:40.186186 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:40.186199 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:40.186280 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.186405 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.186483 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:42:40.190742 5026 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:40.200670 5026 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:40.217962 5239 heartbeater.cc:503] Master 127.17.132.62:40803 was elected leader, sending a full tablet report...
I20260811 01:42:40.240010 5546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.213610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:44627 (local address 127.0.0.1:54066)
0811 01:42:40.223382 (+ 9772us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.223438 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.223613 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.230580 (+ 6967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.230589 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.230638 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:40.231263 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.231282 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.234107 (+ 2825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.234116 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.237214 (+ 3098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.237235 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.238904 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.238910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.239117 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.239163 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.239253 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.239450 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9479,"mutex_wait_us":61,"spinlock_wait_cycles":3328,"thread_start_us":15398,"threads_started":1}
I20260811 01:42:40.240820 5545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.213931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:48644)
0811 01:42:40.229381 (+ 15450us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.229408 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.229592 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.230583 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.230592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.230658 (+ 66us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:40.231859 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.231874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.234482 (+ 2608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.234492 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.237885 (+ 3393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.237901 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.239986 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.239996 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.240300 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.240334 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.240415 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.240533 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15266,"mutex_wait_us":21,"spinlock_wait_cycles":8064,"thread_start_us":8986,"threads_started":1}
I20260811 01:42:40.241133 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.213987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.17.132.3:44627)
0811 01:42:40.229858 (+ 15871us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.229876 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.229913 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:42:40.230024 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.230032 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.230302 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.230899 (+ 597us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:40.231643 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.233876 (+ 2233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.237463 (+ 3587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.238632 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.239515 (+ 883us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.239883 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.239971 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.240167 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15650,"thread_start_us":15896,"threads_started":1}
I20260811 01:42:40.241153 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.214619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.17.132.1:35295)
0811 01:42:40.228978 (+ 14359us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.228992 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.229797 (+ 805us) server_negotiation.cc:407] Connection header received
0811 01:42:40.229937 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.229945 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.230299 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.231306 (+ 1007us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:40.232104 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.234263 (+ 2159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.238139 (+ 3876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.239697 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.240177 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.240474 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.240554 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.240766 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14099,"thread_start_us":13903,"threads_started":1}
I20260811 01:42:40.245564 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.224121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:35197 (local address 127.0.0.1:60010)
0811 01:42:40.235510 (+ 11389us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.235540 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.235722 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.236727 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.236730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.236751 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:40.237353 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.237389 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.239437 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.239441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.242744 (+ 3303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.242761 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.244743 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.244749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.244926 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.244961 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.245066 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.245233 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11246,"thread_start_us":11066,"threads_started":1}
I20260811 01:42:40.245216 5458 tablet_service.cc:1467] Processing CreateTablet for tablet a84070d825f24636b13f8ae95eebd4ee (DEFAULT_TABLE table=test-table [id=1bb4f81a245b40898c5cba43a48dc235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:40.245213 5164 tablet_service.cc:1467] Processing CreateTablet for tablet a84070d825f24636b13f8ae95eebd4ee (DEFAULT_TABLE table=test-table [id=1bb4f81a245b40898c5cba43a48dc235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:40.246493 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.224178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.17.132.2:35197)
0811 01:42:40.235030 (+ 10852us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.235039 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.235661 (+ 622us) server_negotiation.cc:407] Connection header received
0811 01:42:40.235954 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.235963 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.236279 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.236511 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:40.237594 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.239283 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.242980 (+ 3697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.244514 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.244674 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.244909 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.245913 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.246106 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10640,"thread_start_us":11043,"threads_started":1}
I20260811 01:42:40.247272 5458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84070d825f24636b13f8ae95eebd4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:40.247279 5164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84070d825f24636b13f8ae95eebd4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:40.257140 5314 tablet_service.cc:1467] Processing CreateTablet for tablet a84070d825f24636b13f8ae95eebd4ee (DEFAULT_TABLE table=test-table [id=1bb4f81a245b40898c5cba43a48dc235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:40.258452 5314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84070d825f24636b13f8ae95eebd4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:40.259377 5552 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Bootstrap starting.
I20260811 01:42:40.263274 5553 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Bootstrap starting.
I20260811 01:42:40.263532 5552 tablet_bootstrap.cc:654] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:40.264950 5552 log.cc:824] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:40.266837 5553 tablet_bootstrap.cc:654] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:40.268039 5553 log.cc:824] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:40.269038 5552 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: No bootstrap required, opened a new log
I20260811 01:42:40.269363 5552 ts_tablet_manager.cc:1397] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 01:42:40.270892 5553 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: No bootstrap required, opened a new log
I20260811 01:42:40.271170 5553 ts_tablet_manager.cc:1397] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 01:42:40.274573 5557 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Bootstrap starting.
I20260811 01:42:40.278264 5557 tablet_bootstrap.cc:654] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:40.278805 5552 raft_consensus.cc:348] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.279351 5552 raft_consensus.cc:374] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:40.279493 5552 raft_consensus.cc:729] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd45781870e048c2aed97b7cd12f7130, State: Initialized, Role: FOLLOWER
I20260811 01:42:40.279678 5557 log.cc:824] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:40.280144 5552 consensus_queue.cc:260] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.280535 5553 raft_consensus.cc:348] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.281011 5553 raft_consensus.cc:374] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:40.281176 5553 raft_consensus.cc:729] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b7bc631cb4d4063887841ed5391f8ff, State: Initialized, Role: FOLLOWER
I20260811 01:42:40.281798 5553 consensus_queue.cc:260] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.282040 5552 ts_tablet_manager.cc:1428] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260811 01:42:40.283048 5557 tablet_bootstrap.cc:492] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: No bootstrap required, opened a new log
I20260811 01:42:40.283334 5557 ts_tablet_manager.cc:1397] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260811 01:42:40.283625 5553 ts_tablet_manager.cc:1428] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260811 01:42:40.283937 5530 heartbeater.cc:503] Master 127.17.132.62:40803 was elected leader, sending a full tablet report...
I20260811 01:42:40.291522 5557 raft_consensus.cc:348] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.291934 5557 raft_consensus.cc:374] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:40.292062 5557 raft_consensus.cc:729] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b75116ba44411b88cf405e2e9f2ec0, State: Initialized, Role: FOLLOWER
I20260811 01:42:40.292683 5557 consensus_queue.cc:260] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.293891 5388 heartbeater.cc:503] Master 127.17.132.62:40803 was elected leader, sending a full tablet report...
I20260811 01:42:40.294553 5557 ts_tablet_manager.cc:1428] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
I20260811 01:42:40.389925 5560 raft_consensus.cc:482] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:40.390277 5560 raft_consensus.cc:504] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.392010 5560 leader_election.cc:288] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd45781870e048c2aed97b7cd12f7130 (127.17.132.1:35295), 57b75116ba44411b88cf405e2e9f2ec0 (127.17.132.2:35197)
I20260811 01:42:40.398849 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.392582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:36319 (local address 127.17.132.1:35295)
0811 01:42:40.392836 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.392843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.392867 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:42:40.392954 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.392962 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.393061 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.393169 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:40.393750 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.394832 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.396788 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.398034 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.398166 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.398228 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.398556 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.398654 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:42:40.398998 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.392375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.17.132.3:36319)
0811 01:42:40.392588 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.392610 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.392768 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.393388 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.393392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.393414 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:40.393593 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.393600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.394974 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.394979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.396620 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.396633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.398191 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.398196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.398390 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.398426 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.398525 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.398667 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:42:40.399986 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.393155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:42375 (local address 127.17.132.2:35197)
0811 01:42:40.393402 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.393408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.393570 (+ 162us) server_negotiation.cc:407] Connection header received
0811 01:42:40.393876 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.393881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.393954 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.394030 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:40.394668 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.395696 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.397771 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.398942 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.399106 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.399178 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.399574 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.399717 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 01:42:40.399995 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.392786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:35197 (local address 127.17.132.3:42375)
0811 01:42:40.393470 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.393484 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:40.393638 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:40.394087 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:40.394092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:40.394120 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:40.394497 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.394508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.395860 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.395863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.397556 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:40.397574 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.399254 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.399260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:40.399408 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.399432 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:42:40.399544 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 01:42:40.399668 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":335,"threads_started":1}
I20260811 01:42:40.400141 5186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84070d825f24636b13f8ae95eebd4ee" candidate_uuid: "7b7bc631cb4d4063887841ed5391f8ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd45781870e048c2aed97b7cd12f7130" is_pre_election: true
I20260811 01:42:40.400802 5186 raft_consensus.cc:2454] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b7bc631cb4d4063887841ed5391f8ff in term 0.
I20260811 01:42:40.401126 5337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84070d825f24636b13f8ae95eebd4ee" candidate_uuid: "7b7bc631cb4d4063887841ed5391f8ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b75116ba44411b88cf405e2e9f2ec0" is_pre_election: true
I20260811 01:42:40.401547 5410 leader_election.cc:302] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b7bc631cb4d4063887841ed5391f8ff, bd45781870e048c2aed97b7cd12f7130; no voters:
I20260811 01:42:40.401638 5337 raft_consensus.cc:2454] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b7bc631cb4d4063887841ed5391f8ff in term 0.
I20260811 01:42:40.402010 5560 raft_consensus.cc:2781] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:40.402161 5560 raft_consensus.cc:482] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:40.402287 5560 raft_consensus.cc:3037] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:40.404760 5560 raft_consensus.cc:504] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.405349 5560 leader_election.cc:288] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [CANDIDATE]: Term 1 election: Requested vote from peers bd45781870e048c2aed97b7cd12f7130 (127.17.132.1:35295), 57b75116ba44411b88cf405e2e9f2ec0 (127.17.132.2:35197)
I20260811 01:42:40.405885 5186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84070d825f24636b13f8ae95eebd4ee" candidate_uuid: "7b7bc631cb4d4063887841ed5391f8ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd45781870e048c2aed97b7cd12f7130"
I20260811 01:42:40.405936 5337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84070d825f24636b13f8ae95eebd4ee" candidate_uuid: "7b7bc631cb4d4063887841ed5391f8ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b75116ba44411b88cf405e2e9f2ec0"
W20260811 01:42:40.406023 5531 tablet.cc:2369] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:40.406127 5186 raft_consensus.cc:3037] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:40.406159 5337 raft_consensus.cc:3037] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:40.408638 5186 raft_consensus.cc:2454] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b7bc631cb4d4063887841ed5391f8ff in term 1.
I20260811 01:42:40.408818 5337 raft_consensus.cc:2454] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b7bc631cb4d4063887841ed5391f8ff in term 1.
I20260811 01:42:40.409122 5410 leader_election.cc:302] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b7bc631cb4d4063887841ed5391f8ff, bd45781870e048c2aed97b7cd12f7130; no voters:
I20260811 01:42:40.409420 5560 raft_consensus.cc:2781] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:40.409960 5560 raft_consensus.cc:686] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 1 LEADER]: Becoming Leader. State: Replica: 7b7bc631cb4d4063887841ed5391f8ff, State: Running, Role: LEADER
I20260811 01:42:40.410425 5560 consensus_queue.cc:237] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } }
I20260811 01:42:40.415138 5025 catalog_manager.cc:5495] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b7bc631cb4d4063887841ed5391f8ff (127.17.132.3). New cstate: current_term: 1 leader_uuid: "7b7bc631cb4d4063887841ed5391f8ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b7bc631cb4d4063887841ed5391f8ff" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 } health_report { overall_health: UNKNOWN } } }
W20260811 01:42:40.426062 5389 tablet.cc:2369] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:42:40.446590 5240 tablet.cc:2369] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:40.465447 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.460007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33294 (local address 127.17.132.3:44627)
0811 01:42:40.460230 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.460235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.460254 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:42:40.460345 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.460348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.460424 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.460559 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:40.460894 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.461615 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.463164 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.463708 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.463808 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.464329 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:40.464853 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:40.464962 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.465074 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.465143 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 01:42:40.474184 5186 raft_consensus.cc:1261] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 1 FOLLOWER]: Refusing update from remote peer 7b7bc631cb4d4063887841ed5391f8ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:40.474184 5337 raft_consensus.cc:1261] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 1 FOLLOWER]: Refusing update from remote peer 7b7bc631cb4d4063887841ed5391f8ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:40.475327 5563 consensus_queue.cc:1035] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b75116ba44411b88cf405e2e9f2ec0" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:40.475796 5560 consensus_queue.cc:1035] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd45781870e048c2aed97b7cd12f7130" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:40.487736 5566 mvcc.cc:205] Tried to move back new op lower bound from 7317145847690674176 to 7317145847444770816. Current Snapshot: MvccSnapshot[applied={T|T < 7317145847690674176}]
I20260811 01:42:40.501379 5026 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:40.501695 5026 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:40.505878 5026 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 980df17f9b6f46b8a922d66110f1d420: Sending DeleteTablet for 3 replicas of tablet a84070d825f24636b13f8ae95eebd4ee
I20260811 01:42:40.507030 5458 tablet_service.cc:1514] Processing DeleteTablet for tablet a84070d825f24636b13f8ae95eebd4ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:40 UTC) from {username='slave'} at 127.0.0.1:54066
I20260811 01:42:40.507227 5314 tablet_service.cc:1514] Processing DeleteTablet for tablet a84070d825f24636b13f8ae95eebd4ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:40 UTC) from {username='slave'} at 127.0.0.1:60010
I20260811 01:42:40.507546 5164 tablet_service.cc:1514] Processing DeleteTablet for tablet a84070d825f24636b13f8ae95eebd4ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:40 UTC) from {username='slave'} at 127.0.0.1:48644
I20260811 01:42:40.508014 5575 tablet_replica.cc:330] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: stopping tablet replica
I20260811 01:42:40.508466 5575 raft_consensus.cc:2229] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:40.508884 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5096
I20260811 01:42:40.509222 5575 raft_consensus.cc:2258] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:40.511960 5575 ts_tablet_manager.cc:1905] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:40.521531 5575 ts_tablet_manager.cc:1918] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:40.521735 5575 log.cc:1196] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/a84070d825f24636b13f8ae95eebd4ee
I20260811 01:42:40.522455 5575 ts_tablet_manager.cc:1939] T a84070d825f24636b13f8ae95eebd4ee P 7b7bc631cb4d4063887841ed5391f8ff: Deleting consensus metadata
I20260811 01:42:40.523362 5577 tablet_replica.cc:330] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: stopping tablet replica
I20260811 01:42:40.523905 5577 raft_consensus.cc:2229] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:40.524451 5011 catalog_manager.cc:4841] TS 7b7bc631cb4d4063887841ed5391f8ff (127.17.132.3:44627): tablet a84070d825f24636b13f8ae95eebd4ee (table test-table [id=1bb4f81a245b40898c5cba43a48dc235]) successfully deleted
I20260811 01:42:40.524547 5577 raft_consensus.cc:2258] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:40.526064 5576 tablet_replica.cc:330] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: stopping tablet replica
I20260811 01:42:40.526477 5576 raft_consensus.cc:2229] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:40.526952 5576 raft_consensus.cc:2258] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:40.527837 5577 ts_tablet_manager.cc:1905] T a84070d825f24636b13f8ae95eebd4ee P bd45781870e048c2aed97b7cd12f7130: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:40.529470 5576 ts_tablet_manager.cc:1905] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:40.529657 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.510556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.17.132.1:35295)
0811 01:42:40.510737 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.510743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.517487 (+ 6744us) server_negotiation.cc:407] Connection header received
0811 01:42:40.518471 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.518479 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.518592 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.518665 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:40.519846 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.521025 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.523881 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.524621 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.524729 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.527777 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:40.527789 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:40.527806 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:40.528605 (+ 799us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:40.528673 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:40.528713 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:40.528828 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.529128 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.529265 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:42:40.530933 5233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:40.537644 5576 ts_tablet_manager.cc:1918] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:40.537897 5576 log.cc:1196] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/a84070d825f24636b13f8ae95eebd4ee
I20260811 01:42:40.538455 5576 ts_tablet_manager.cc:1939] T a84070d825f24636b13f8ae95eebd4ee P 57b75116ba44411b88cf405e2e9f2ec0: Deleting consensus metadata
I20260811 01:42:40.540323 5012 catalog_manager.cc:4841] TS 57b75116ba44411b88cf405e2e9f2ec0 (127.17.132.2:35197): tablet a84070d825f24636b13f8ae95eebd4ee (table test-table [id=1bb4f81a245b40898c5cba43a48dc235]) successfully deleted
I20260811 01:42:40.643128 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5096
W20260811 01:42:40.676348 5012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:35295 (error 108)
I20260811 01:42:40.676472 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5243
I20260811 01:42:40.679790 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.679209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41392)
0811 01:42:40.679467 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.679597 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260811 01:42:40.680087 5012 catalog_manager.cc:4584] TS bd45781870e048c2aed97b7cd12f7130 (127.17.132.1:35295): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a84070d825f24636b13f8ae95eebd4ee: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
I20260811 01:42:40.686362 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.677973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46174 (local address 127.17.132.2:35197)
0811 01:42:40.678196 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.678206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.678235 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:42:40.678301 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.678306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.678427 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.678543 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:40.679040 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.680290 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.682400 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.683105 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.683249 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.684612 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:40.684624 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:40.684645 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:40.685442 (+ 797us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:40.685507 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:40.685534 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:40.685656 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.685841 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.685960 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 01:42:40.687094 5382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:40.734045 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.733428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41400)
0811 01:42:40.733690 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.733841 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 01:42:40.735248 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.734853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41402)
0811 01:42:40.735014 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.735098 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:42:40.782338 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5243
I20260811 01:42:40.796433 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.795759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41406)
0811 01:42:40.796040 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.796182 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 01:42:40.797878 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.797386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41416)
0811 01:42:40.797580 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.797680 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 01:42:40.804971 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5391
I20260811 01:42:40.813371 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.806060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.17.132.3:44627)
0811 01:42:40.806274 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:40.806280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:40.806307 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:42:40.806378 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:40.806383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:40.806484 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:40.806620 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:40.807030 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.808253 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.809572 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:40.810297 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:40.810433 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:40.811565 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:40.811581 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:40.811603 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:40.812506 (+ 903us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:40.812574 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:40.812600 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:40.812709 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:40.812844 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 01:42:40.812947 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:42:40.814173 5524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:40.879303 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.878656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41418)
0811 01:42:40.878942 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.879063 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 01:42:40.880524 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:40.880053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41432)
0811 01:42:40.880303 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:40.880392 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 01:42:40.937915 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5391
I20260811 01:42:40.960810 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 4995
I20260811 01:42:40.962008 5062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:41.074108 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:41.073385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:35295 (local address 127.0.0.1:41434)
0811 01:42:41.073677 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:41.073822 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:35295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 01:42:41.074083 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 4995
2026-08-11T01:42:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3013 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:42:41 dist-test-slave-0kls krb5kdc[5588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:42:41 dist-test-slave-0kls krb5kdc[5588](info): set up 2 sockets
Aug 11 01:42:41 dist-test-slave-0kls krb5kdc[5588](info): commencing operation
krb5kdc: starting...
W20260811 01:42:42.252346 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:42:42 dist-test-slave-0kls krb5kdc[5588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:42:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:42:42.585942 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45957
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:45957
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:42.945901 5602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:42.946236 5602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:42.946405 5602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:42.953974 5602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:42.954093 5602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:42.954200 5602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:42.954309 5602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:42.954427 5602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:42.965708 5602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:45957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:42.967321 5602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:42.968787 5602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:42.981683 5609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:42.981688 5610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:42.981738 5612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:42.982872 5602 server_base.cc:1034] running on GCE node
I20260811 01:42:42.983775 5602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:42.985285 5602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:42.986524 5602 hybrid_clock.cc:648] HybridClock initialized: now 1786412562986476 us; error 59 us; skew 500 ppm
I20260811 01:42:42.986887 5602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:42 dist-test-slave-0kls krb5kdc[5588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:42.990231 5602 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:42:42.991796 5602 webserver.cc:460] Webserver started at http://127.17.132.62:33469/ using document root <none> and password file <none>
I20260811 01:42:42.992568 5602 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:42.992736 5602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:42.993088 5602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:42.996531 5602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "10e4a68aa21f47e9bafafcb48525dabc"
format_stamp: "Formatted at 2026-08-11 01:42:42 on dist-test-slave-0kls"
server_key: "b90d578fd01a4232ea8836a9336ce21f"
server_key_iv: "b5b2c9468cf36c8de7055c996b9e91ed"
server_key_version: "encryptionkey@0"
I20260811 01:42:42.997372 5602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "10e4a68aa21f47e9bafafcb48525dabc"
format_stamp: "Formatted at 2026-08-11 01:42:42 on dist-test-slave-0kls"
server_key: "b90d578fd01a4232ea8836a9336ce21f"
server_key_iv: "b5b2c9468cf36c8de7055c996b9e91ed"
server_key_version: "encryptionkey@0"
I20260811 01:42:43.003590 5602 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260811 01:42:43.007660 5619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:43.009146 5602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:42:43.009372 5602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "10e4a68aa21f47e9bafafcb48525dabc"
format_stamp: "Formatted at 2026-08-11 01:42:42 on dist-test-slave-0kls"
server_key: "b90d578fd01a4232ea8836a9336ce21f"
server_key_iv: "b5b2c9468cf36c8de7055c996b9e91ed"
server_key_version: "encryptionkey@0"
I20260811 01:42:43.009598 5602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:43.049401 5602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:43.054366 5602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:43.054698 5602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:43.074141 5602 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:45957
I20260811 01:42:43.074160 5673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:45957 every 8 connection(s)
I20260811 01:42:43.075635 5602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:43.079468 5674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:43.081396 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5602
I20260811 01:42:43.081607 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:43.082253 17936 external_mini_cluster.cc:1428] Setting key 93277da5fa306818c0a21c831946c835
I20260811 01:42:43.093812 5674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: Bootstrap starting.
Aug 11 01:42:43 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:43.098027 5674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:43.099092 5674 log.cc:824] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:43.102344 5674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: No bootstrap required, opened a new log
I20260811 01:42:43.106854 5677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:43.084179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.17.132.62:45957)
0811 01:42:43.085028 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:43.085040 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:43.085085 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:42:43.086773 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:43.086798 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:43.087166 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:43.087489 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:43.089406 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.090958 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.092965 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.093644 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.093771 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:43.098899 (+ 5128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:43.098907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:43.098922 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:43.098963 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:43.102538 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:43.103297 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:43.103306 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:43.103315 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:43.103499 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:43.103900 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:43.103905 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:43.103909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:43.104499 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:43.104826 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:43.105320 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 01:42:43.105773 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":368,"threads_started":1}
I20260811 01:42:43.110690 5674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } }
I20260811 01:42:43.111109 5674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:43.111222 5674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e4a68aa21f47e9bafafcb48525dabc, State: Initialized, Role: FOLLOWER
I20260811 01:42:43.111825 5674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } }
I20260811 01:42:43.112102 5674 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:43.112258 5674 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:43.112455 5674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:43.115088 5674 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } }
I20260811 01:42:43.115592 5674 leader_election.cc:302] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10e4a68aa21f47e9bafafcb48525dabc; no voters:
I20260811 01:42:43.116149 5674 leader_election.cc:288] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:43.116294 5679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:43.117026 5679 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [term 1 LEADER]: Becoming Leader. State: Replica: 10e4a68aa21f47e9bafafcb48525dabc, State: Running, Role: LEADER
I20260811 01:42:43.117743 5679 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } }
I20260811 01:42:43.118656 5674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:43.120793 5682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10e4a68aa21f47e9bafafcb48525dabc. Latest consensus state: current_term: 1 leader_uuid: "10e4a68aa21f47e9bafafcb48525dabc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } } }
I20260811 01:42:43.120923 5681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10e4a68aa21f47e9bafafcb48525dabc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4a68aa21f47e9bafafcb48525dabc" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45957 } } }
I20260811 01:42:43.121248 5681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:43.121253 5682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:43.126536 5689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:43.131702 5689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:43.141243 5689 catalog_manager.cc:1347] Generated new cluster ID: 717d57e8c20a45888b61cc544cbe687b
I20260811 01:42:43.141429 5689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:43.160341 5689 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:43.161885 5689 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:43.168422 5689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: Generated new TSK 0
I20260811 01:42:43.169540 5689 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:42:43.250669 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:43.611599 5704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:43.612075 5704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:43.612280 5704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:43.621377 5704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:43.621515 5704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:43.621640 5704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:43.633172 5704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:43.634716 5704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:43.636199 5704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:43.651316 5710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:43.651294 5709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:43.651293 5713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:43.652287 5704 server_base.cc:1034] running on GCE node
I20260811 01:42:43.653007 5704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:43.654170 5704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:43.655388 5704 hybrid_clock.cc:648] HybridClock initialized: now 1786412563655337 us; error 36 us; skew 500 ppm
I20260811 01:42:43.655741 5704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:43 dist-test-slave-0kls krb5kdc[5588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:43.662779 5704 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:42:43.664681 5704 webserver.cc:460] Webserver started at http://127.17.132.1:35497/ using document root <none> and password file <none>
I20260811 01:42:43.665464 5704 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:43.665611 5704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:43.666031 5704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:43.669404 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "fbcf3208c85c469797febe94981b8e2b"
format_stamp: "Formatted at 2026-08-11 01:42:43 on dist-test-slave-0kls"
server_key: "be325692d773cd72f1dee759ae7ac1f3"
server_key_iv: "408d323024f891ba0dce0de7c26c22b5"
server_key_version: "encryptionkey@0"
I20260811 01:42:43.670244 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "fbcf3208c85c469797febe94981b8e2b"
format_stamp: "Formatted at 2026-08-11 01:42:43 on dist-test-slave-0kls"
server_key: "be325692d773cd72f1dee759ae7ac1f3"
server_key_iv: "408d323024f891ba0dce0de7c26c22b5"
server_key_version: "encryptionkey@0"
I20260811 01:42:43.675688 5704 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:42:43.679486 5720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:43.681077 5704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:42:43.681322 5704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "fbcf3208c85c469797febe94981b8e2b"
format_stamp: "Formatted at 2026-08-11 01:42:43 on dist-test-slave-0kls"
server_key: "be325692d773cd72f1dee759ae7ac1f3"
server_key_iv: "408d323024f891ba0dce0de7c26c22b5"
server_key_version: "encryptionkey@0"
I20260811 01:42:43.681556 5704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:43.697896 5704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:43.702672 5704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:43.703004 5704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:43.704133 5704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:43.705569 5704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:43.705651 5704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:43.705865 5704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:43.705942 5704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 01:42:43.740944 5704 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:38047
I20260811 01:42:43.740996 5843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:38047 every 8 connection(s)
I20260811 01:42:43.742359 5704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:43.743728 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5704
I20260811 01:42:43.743959 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:43.744616 17936 external_mini_cluster.cc:1428] Setting key 94187cb8fd59e758dbf4cd738450ebd9
Aug 11 01:42:43 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:43.765539 5847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:43.745044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:44335 (local address 127.17.132.62:45957)
0811 01:42:43.745997 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:43.746006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:43.746460 (+ 454us) server_negotiation.cc:407] Connection header received
0811 01:42:43.749345 (+ 2885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:43.749350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:43.749421 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:43.749504 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:43.751563 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.752281 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.754744 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.755141 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.755255 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:43.759553 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:43.759558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:43.759561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:43.759595 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:43.762294 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:43.763090 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:43.763094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:43.763097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:43.763221 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:43.763678 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:43.763682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:43.763684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:43.763953 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:43.764114 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:43.764914 (+ 800us) server_negotiation.cc:299] Negotiation successful
0811 01:42:43.765152 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":665,"threads_started":1}
I20260811 01:42:43.766681 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:43.745491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:45957 (local address 127.17.132.1:44335)
0811 01:42:43.746307 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:43.746344 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:43.749034 (+ 2690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:43.749816 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:43.749831 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:43.750603 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:43.751386 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:43.751412 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.752446 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.752454 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:43.754596 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:43.754614 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:43.755385 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:43.755394 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:43.755740 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:43.756502 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:43.756545 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:43.759299 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:43.762447 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:43.762457 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:43.762475 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:43.762949 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:43.763336 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:43.763342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:43.763345 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:43.763548 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:43.764084 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:43.764093 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:43.764493 (+ 400us) client_negotiation.cc:769] Sending connection context
0811 01:42:43.764810 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 01:42:43.765366 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":857,"threads_started":1}
I20260811 01:42:43.768352 5844 heartbeater.cc:347] Connected to a master server at 127.17.132.62:45957
I20260811 01:42:43.768683 5844 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:43.769484 5844 heartbeater.cc:511] Master 127.17.132.62:45957 requested a full tablet report, sending...
I20260811 01:42:43.771775 5636 ts_manager.cc:194] Registered new tserver with Master: fbcf3208c85c469797febe94981b8e2b (127.17.132.1:38047)
I20260811 01:42:43.773238 5636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:44335
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:42:43.817189 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:44.175192 5852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:44.175526 5852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:44.175626 5852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:44.183420 5852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:44.183568 5852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:44.183686 5852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:44.194203 5852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:44.195535 5852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:44.196875 5852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:44.210752 5857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:44.210824 5858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:44.210800 5860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:44.211863 5852 server_base.cc:1034] running on GCE node
I20260811 01:42:44.212433 5852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:44.213485 5852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:44.214710 5852 hybrid_clock.cc:648] HybridClock initialized: now 1786412564214666 us; error 54 us; skew 500 ppm
I20260811 01:42:44.215049 5852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:44 dist-test-slave-0kls krb5kdc[5588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412564, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:44.218277 5852 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:42:44.220054 5852 webserver.cc:460] Webserver started at http://127.17.132.2:39961/ using document root <none> and password file <none>
I20260811 01:42:44.220774 5852 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:44.220927 5852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:44.221262 5852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:44.224381 5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "e667338ac05c4231b66b65ba06fc6f87"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "2122b929b7b7c1068742c2528d530ef1"
server_key_iv: "9fbde8e5cafffae288b3cd63d7c278c5"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.225191 5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "e667338ac05c4231b66b65ba06fc6f87"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "2122b929b7b7c1068742c2528d530ef1"
server_key_iv: "9fbde8e5cafffae288b3cd63d7c278c5"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.230820 5852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:42:44.234457 5868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.236271 5852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:44.236495 5852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e667338ac05c4231b66b65ba06fc6f87"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "2122b929b7b7c1068742c2528d530ef1"
server_key_iv: "9fbde8e5cafffae288b3cd63d7c278c5"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.236740 5852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:44.267464 5852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:44.272063 5852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:44.272342 5852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:44.273316 5852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:44.274799 5852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:44.274875 5852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.274963 5852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:44.275008 5852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.310423 5852 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:33153
I20260811 01:42:44.310480 5991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:33153 every 8 connection(s)
I20260811 01:42:44.311864 5852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:44.320470 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5852
I20260811 01:42:44.320711 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:44.321384 17936 external_mini_cluster.cc:1428] Setting key 0b0893039d9deb2cad68e878a77924db
Aug 11 01:42:44 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412564, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:44.337399 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.314958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:56803 (local address 127.17.132.62:45957)
0811 01:42:44.315469 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.315473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.316740 (+ 1267us) server_negotiation.cc:407] Connection header received
0811 01:42:44.319200 (+ 2460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.319206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.319312 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.319479 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:44.321887 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.322791 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.325216 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.325767 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.325927 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.330861 (+ 4934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:44.330866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:44.330869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:44.330908 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:44.333644 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.334784 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.334788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.334791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.334931 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.335477 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.335480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.335482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.335783 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:44.335909 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.336914 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.337104 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":262,"threads_started":1}
I20260811 01:42:44.338678 5995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.315703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:45957 (local address 127.17.132.2:56803)
0811 01:42:44.316518 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:44.316567 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:44.318849 (+ 2282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:44.319773 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:44.319782 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:44.320604 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:44.321580 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.321613 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.322974 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.322979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.325010 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.325046 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.326083 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.326093 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.326477 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.327308 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:44.327344 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:44.330546 (+ 3202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:44.333853 (+ 3307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:44.333867 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:44.333890 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:44.334633 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:44.335058 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:44.335065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:44.335072 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:44.335356 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:44.335925 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:44.335936 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:44.336479 (+ 543us) client_negotiation.cc:769] Sending connection context
0811 01:42:44.336815 (+ 336us) client_negotiation.cc:240] Negotiation successful
0811 01:42:44.337461 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":348,"threads_started":1}
I20260811 01:42:44.340438 5992 heartbeater.cc:347] Connected to a master server at 127.17.132.62:45957
I20260811 01:42:44.340886 5992 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:44.341859 5992 heartbeater.cc:511] Master 127.17.132.62:45957 requested a full tablet report, sending...
I20260811 01:42:44.343391 5636 ts_manager.cc:194] Registered new tserver with Master: e667338ac05c4231b66b65ba06fc6f87 (127.17.132.2:33153)
I20260811 01:42:44.344261 5636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:56803
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:42:44.393594 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:44.759243 5998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:44.759606 5998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:44.759809 5998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:44.767942 5998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:44.768111 5998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:44.768292 5998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:44.776347 5844 heartbeater.cc:503] Master 127.17.132.62:45957 was elected leader, sending a full tablet report...
I20260811 01:42:44.778895 5998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:45957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:44.780356 5998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:44.781716 5998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:44.796316 6008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:44.796379 6005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:44.796408 6006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:44.797279 5998 server_base.cc:1034] running on GCE node
I20260811 01:42:44.798033 5998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:44.799113 5998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:44.800359 5998 hybrid_clock.cc:648] HybridClock initialized: now 1786412564800294 us; error 51 us; skew 500 ppm
I20260811 01:42:44.800685 5998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:44 dist-test-slave-0kls krb5kdc[5588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412564, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:44.804059 5998 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:42:44.805639 5998 webserver.cc:460] Webserver started at http://127.17.132.3:43665/ using document root <none> and password file <none>
I20260811 01:42:44.806433 5998 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:44.806540 5998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:44.806826 5998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:44.809854 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "a207daf841e64c5b90012f210f800885"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "8e0e0ffdc0b30541c8a897ac4f852900"
server_key_iv: "29d8f6bdb46211018f8c41d85d660640"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.810731 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "a207daf841e64c5b90012f210f800885"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "8e0e0ffdc0b30541c8a897ac4f852900"
server_key_iv: "29d8f6bdb46211018f8c41d85d660640"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.816357 5998 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:42:44.820149 6015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.821624 5998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:44.821832 5998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "a207daf841e64c5b90012f210f800885"
format_stamp: "Formatted at 2026-08-11 01:42:44 on dist-test-slave-0kls"
server_key: "8e0e0ffdc0b30541c8a897ac4f852900"
server_key_iv: "29d8f6bdb46211018f8c41d85d660640"
server_key_version: "encryptionkey@0"
I20260811 01:42:44.822046 5998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:44.843442 5998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:44.847564 5998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:44.847831 5998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:44.848766 5998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:44.850203 5998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:44.850281 5998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.850375 5998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:44.850420 5998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:44.885625 5998 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:35899
I20260811 01:42:44.885756 6139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:35899 every 8 connection(s)
I20260811 01:42:44.887135 5998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:44.897542 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 5998
I20260811 01:42:44.897773 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:44.898386 17936 external_mini_cluster.cc:1428] Setting key a42425d7ea992f6be282bd8665af032a
Aug 11 01:42:44 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412564, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:44.908469 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.889874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:34679 (local address 127.17.132.62:45957)
0811 01:42:44.890384 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.890390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.891412 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 01:42:44.893214 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.893219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.893302 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.893404 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:44.894960 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.895753 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.897550 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.898234 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.898378 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.902428 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:44.902432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:44.902435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:44.902469 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:44.905155 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.906133 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.906137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.906139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.906277 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.906806 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.906810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.906812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.907097 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:44.907219 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.907977 (+ 758us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.908162 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":215,"threads_started":1}
I20260811 01:42:44.910054 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.890519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:45957 (local address 127.17.132.3:34679)
0811 01:42:44.891235 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:44.891274 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:44.892957 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:44.893617 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:44.893625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:44.894231 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:44.894793 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.894810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.895893 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.895897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.897359 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.897373 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.898517 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.898525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.898759 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.899588 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:44.899654 (+ 66us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:44.902211 (+ 2557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:44.905360 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:44.905369 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:44.905386 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:44.906007 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:44.906396 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:44.906400 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:44.906402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:44.906693 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:44.907227 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:44.907235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:44.907623 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 01:42:44.907866 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 01:42:44.908306 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":303,"threads_started":1}
I20260811 01:42:44.911595 6140 heartbeater.cc:347] Connected to a master server at 127.17.132.62:45957
I20260811 01:42:44.911973 6140 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:44.912938 6140 heartbeater.cc:511] Master 127.17.132.62:45957 requested a full tablet report, sending...
I20260811 01:42:44.914728 5636 ts_manager.cc:194] Registered new tserver with Master: a207daf841e64c5b90012f210f800885 (127.17.132.3:35899)
I20260811 01:42:44.915520 5636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:34679
I20260811 01:42:44.926743 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:44.944399 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.931071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.17.132.62:45957)
0811 01:42:44.931316 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.931322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.931596 (+ 274us) server_negotiation.cc:407] Connection header received
0811 01:42:44.931748 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.931752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.931820 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.931906 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:44.933309 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.934101 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.935420 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.935852 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.935965 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.938888 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:44.938892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:44.938895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:44.938930 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:44.941659 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.942483 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.942487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.942489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.942605 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:44.943011 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:44.943019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:44.943021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:44.943350 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:44.943557 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.943889 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.944033 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:42:44.948535 5636 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:44.955582 5636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:44.989604 6155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.967916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:35899 (local address 127.0.0.1:47504)
0811 01:42:44.979773 (+ 11857us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:44.979796 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:44.979940 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:44.981063 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:44.981068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:44.981088 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:44.981753 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.981776 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.983720 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.983728 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.986605 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.986620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.988487 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.988493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.988712 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.988776 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 01:42:44.988914 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 01:42:44.989132 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11679,"mutex_wait_us":81,"thread_start_us":10194,"threads_started":1}
I20260811 01:42:44.990278 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.980309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.17.132.1:38047)
0811 01:42:44.980995 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.981003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.982265 (+ 1262us) server_negotiation.cc:407] Connection header received
0811 01:42:44.982374 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.982381 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.982627 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.982811 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:44.983547 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.985045 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.987452 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.988478 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.988620 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.988852 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.989711 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.989927 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":396,"threads_started":1}
I20260811 01:42:44.990437 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.967835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35996 (local address 127.17.132.2:33153)
0811 01:42:44.980112 (+ 12277us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.980122 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.980148 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:42:44.980243 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.980249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.980497 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.981233 (+ 736us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:44.981927 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.983523 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.986716 (+ 3193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.988257 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.988405 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.988624 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.989894 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.990079 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12093,"thread_start_us":11977,"threads_started":1}
I20260811 01:42:44.990610 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.968717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.17.132.3:35899)
0811 01:42:44.978128 (+ 9411us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:44.978139 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:44.980088 (+ 1949us) server_negotiation.cc:407] Connection header received
0811 01:42:44.980216 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:44.980226 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:44.980499 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:44.980721 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:44.982046 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.983537 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.986783 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.988262 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.988405 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.988656 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:44.990078 (+ 1422us) server_negotiation.cc:299] Negotiation successful
0811 01:42:44.990258 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9139,"thread_start_us":8857,"threads_started":1}
I20260811 01:42:44.990793 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.981032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:38047 (local address 127.0.0.1:35008)
0811 01:42:44.981976 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:44.981994 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:44.982110 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:44.983010 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:44.983014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:44.983040 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:44.983377 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.983386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.985183 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.985191 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.987287 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.987299 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.989001 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.989008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.989162 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.989189 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 01:42:44.989299 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:42:44.989422 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":20,"thread_start_us":596,"threads_started":1}
I20260811 01:42:44.990928 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:44.967801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:33153 (local address 127.0.0.1:35996)
0811 01:42:44.978671 (+ 10870us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:44.978742 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:44.979016 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:44.980763 (+ 1747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:44.980774 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:44.980810 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:44.981621 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.981646 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.983661 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.983667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.986538 (+ 2871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:44.986550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:44.988814 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:44.988819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:44.989023 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:44.989056 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:42:44.989156 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:42:44.989343 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10501,"mutex_wait_us":9,"thread_start_us":11620,"threads_started":1}
I20260811 01:42:44.994825 5772 tablet_service.cc:1467] Processing CreateTablet for tablet e64155c5cd3345df994802d747a91127 (DEFAULT_TABLE table=test-table [id=1e5ba06bf4ad43b688f277e09fd740db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:44.994808 6070 tablet_service.cc:1467] Processing CreateTablet for tablet e64155c5cd3345df994802d747a91127 (DEFAULT_TABLE table=test-table [id=1e5ba06bf4ad43b688f277e09fd740db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:44.996470 5772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e64155c5cd3345df994802d747a91127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:44.996498 6070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e64155c5cd3345df994802d747a91127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:44.997377 5922 tablet_service.cc:1467] Processing CreateTablet for tablet e64155c5cd3345df994802d747a91127 (DEFAULT_TABLE table=test-table [id=1e5ba06bf4ad43b688f277e09fd740db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:44.998965 5922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e64155c5cd3345df994802d747a91127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:45.010190 6161 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Bootstrap starting.
I20260811 01:42:45.013054 6162 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Bootstrap starting.
I20260811 01:42:45.014336 6161 tablet_bootstrap.cc:654] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:45.015815 6161 log.cc:824] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:45.017335 6162 tablet_bootstrap.cc:654] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:45.019068 6162 log.cc:824] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:45.021210 6163 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Bootstrap starting.
I20260811 01:42:45.023144 6162 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: No bootstrap required, opened a new log
I20260811 01:42:45.023486 6162 ts_tablet_manager.cc:1397] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260811 01:42:45.025918 6161 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: No bootstrap required, opened a new log
I20260811 01:42:45.026225 6161 ts_tablet_manager.cc:1397] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20260811 01:42:45.026840 6163 tablet_bootstrap.cc:654] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:45.028175 6163 log.cc:824] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:45.031319 6163 tablet_bootstrap.cc:492] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: No bootstrap required, opened a new log
I20260811 01:42:45.031642 6163 ts_tablet_manager.cc:1397] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 01:42:45.034900 6162 raft_consensus.cc:348] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.035597 6162 raft_consensus.cc:374] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:45.035750 6162 raft_consensus.cc:729] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a207daf841e64c5b90012f210f800885, State: Initialized, Role: FOLLOWER
I20260811 01:42:45.036557 6162 consensus_queue.cc:260] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.037371 6161 raft_consensus.cc:348] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.037883 6161 raft_consensus.cc:374] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:45.037886 6140 heartbeater.cc:503] Master 127.17.132.62:45957 was elected leader, sending a full tablet report...
I20260811 01:42:45.037988 6161 raft_consensus.cc:729] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbcf3208c85c469797febe94981b8e2b, State: Initialized, Role: FOLLOWER
I20260811 01:42:45.038682 6162 ts_tablet_manager.cc:1428] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260811 01:42:45.038661 6161 consensus_queue.cc:260] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.040935 6161 ts_tablet_manager.cc:1428] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260811 01:42:45.042927 6163 raft_consensus.cc:348] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.043380 6163 raft_consensus.cc:374] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:45.043529 6163 raft_consensus.cc:729] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e667338ac05c4231b66b65ba06fc6f87, State: Initialized, Role: FOLLOWER
I20260811 01:42:45.044307 6163 consensus_queue.cc:260] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.045598 5992 heartbeater.cc:503] Master 127.17.132.62:45957 was elected leader, sending a full tablet report...
I20260811 01:42:45.046211 6163 ts_tablet_manager.cc:1428] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
W20260811 01:42:45.064240 5993 tablet.cc:2369] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:42:45.139048 6141 tablet.cc:2369] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:45.218235 6170 raft_consensus.cc:482] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:45.218597 6170 raft_consensus.cc:504] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.220523 6170 leader_election.cc:288] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e667338ac05c4231b66b65ba06fc6f87 (127.17.132.2:33153), fbcf3208c85c469797febe94981b8e2b (127.17.132.1:38047)
I20260811 01:42:45.228116 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.221037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:33153 (local address 127.17.132.3:35545)
0811 01:42:45.221622 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:45.221639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:45.221863 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:45.222342 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:45.222353 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:45.222385 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:45.222637 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:45.222657 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.224021 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.224027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:45.226029 (+ 2002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:45.226044 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.227409 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.227416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:45.227631 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.227657 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:42:45.227780 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 01:42:45.227894 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456}
I20260811 01:42:45.228152 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.221164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:35545 (local address 127.17.132.2:33153)
0811 01:42:45.221404 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.221412 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.221737 (+ 325us) server_negotiation.cc:407] Connection header received
0811 01:42:45.222084 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.222089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.222183 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.222283 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:45.222802 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.223842 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.226211 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.227231 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.227408 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.227490 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.227809 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.227949 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:42:45.229224 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.221231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:44301 (local address 127.17.132.1:38047)
0811 01:42:45.221450 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.221458 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.222498 (+ 1040us) server_negotiation.cc:407] Connection header received
0811 01:42:45.222655 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.222659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.222758 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.222868 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:45.223631 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.224538 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.226786 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.227622 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.227828 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.227897 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.228847 (+ 950us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.228985 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:42:45.229300 6174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.221202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:38047 (local address 127.17.132.3:44301)
0811 01:42:45.222366 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:45.222383 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:45.222517 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:45.222904 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:45.222912 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:45.222943 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:45.223356 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:45.223367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.224692 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.224697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:45.226545 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:45.226563 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.228441 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.228447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:45.228672 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.228706 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:42:45.228817 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:42:45.228945 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"thread_start_us":739,"threads_started":1}
I20260811 01:42:45.229537 5944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e64155c5cd3345df994802d747a91127" candidate_uuid: "a207daf841e64c5b90012f210f800885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e667338ac05c4231b66b65ba06fc6f87" is_pre_election: true
I20260811 01:42:45.230229 5944 raft_consensus.cc:2454] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a207daf841e64c5b90012f210f800885 in term 0.
I20260811 01:42:45.230471 5793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e64155c5cd3345df994802d747a91127" candidate_uuid: "a207daf841e64c5b90012f210f800885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbcf3208c85c469797febe94981b8e2b" is_pre_election: true
I20260811 01:42:45.231132 5793 raft_consensus.cc:2454] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a207daf841e64c5b90012f210f800885 in term 0.
I20260811 01:42:45.231145 6017 leader_election.cc:302] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a207daf841e64c5b90012f210f800885, e667338ac05c4231b66b65ba06fc6f87; no voters:
I20260811 01:42:45.231611 6170 raft_consensus.cc:2781] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:45.231804 6170 raft_consensus.cc:482] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:45.231941 6170 raft_consensus.cc:3037] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:45.234295 6170 raft_consensus.cc:504] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.234926 6170 leader_election.cc:288] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [CANDIDATE]: Term 1 election: Requested vote from peers e667338ac05c4231b66b65ba06fc6f87 (127.17.132.2:33153), fbcf3208c85c469797febe94981b8e2b (127.17.132.1:38047)
I20260811 01:42:45.235441 5793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e64155c5cd3345df994802d747a91127" candidate_uuid: "a207daf841e64c5b90012f210f800885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbcf3208c85c469797febe94981b8e2b"
I20260811 01:42:45.235664 5793 raft_consensus.cc:3037] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:45.238235 5793 raft_consensus.cc:2454] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a207daf841e64c5b90012f210f800885 in term 1.
I20260811 01:42:45.238579 5944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e64155c5cd3345df994802d747a91127" candidate_uuid: "a207daf841e64c5b90012f210f800885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e667338ac05c4231b66b65ba06fc6f87"
I20260811 01:42:45.238765 6018 leader_election.cc:302] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a207daf841e64c5b90012f210f800885, fbcf3208c85c469797febe94981b8e2b; no voters:
I20260811 01:42:45.238826 5944 raft_consensus.cc:3037] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:45.239123 6170 raft_consensus.cc:2781] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:45.239720 6170 raft_consensus.cc:686] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 1 LEADER]: Becoming Leader. State: Replica: a207daf841e64c5b90012f210f800885, State: Running, Role: LEADER
I20260811 01:42:45.240425 6170 consensus_queue.cc:237] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } }
I20260811 01:42:45.241555 5944 raft_consensus.cc:2454] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a207daf841e64c5b90012f210f800885 in term 1.
W20260811 01:42:45.245563 5846 tablet.cc:2369] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:45.245896 5635 catalog_manager.cc:5495] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 reported cstate change: term changed from 0 to 1, leader changed from <none> to a207daf841e64c5b90012f210f800885 (127.17.132.3). New cstate: current_term: 1 leader_uuid: "a207daf841e64c5b90012f210f800885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a207daf841e64c5b90012f210f800885" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 35899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 } health_report { overall_health: UNKNOWN } } }
I20260811 01:42:45.295521 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.289987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47518 (local address 127.17.132.3:35899)
0811 01:42:45.290207 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.290211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.290231 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:42:45.290416 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.290420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.290515 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.290645 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:45.291018 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.291766 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.293184 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.293588 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.293683 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.294300 (+ 617us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:45.294831 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:45.294963 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.295099 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.295176 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:42:45.304064 5944 raft_consensus.cc:1261] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 1 FOLLOWER]: Refusing update from remote peer a207daf841e64c5b90012f210f800885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:45.304060 5793 raft_consensus.cc:1261] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 1 FOLLOWER]: Refusing update from remote peer a207daf841e64c5b90012f210f800885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:45.305339 6175 consensus_queue.cc:1035] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e667338ac05c4231b66b65ba06fc6f87" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 33153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:45.305738 6170 consensus_queue.cc:1035] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbcf3208c85c469797febe94981b8e2b" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:45.320613 6178 mvcc.cc:205] Tried to move back new op lower bound from 7317145867474935808 to 7317145867229499392. Current Snapshot: MvccSnapshot[applied={T|T < 7317145867474935808}]
I20260811 01:42:45.327246 6180 mvcc.cc:205] Tried to move back new op lower bound from 7317145867474935808 to 7317145867229499392. Current Snapshot: MvccSnapshot[applied={T|T < 7317145867474935808}]
I20260811 01:42:45.349802 5635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:45.350302 5635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:45.357368 5772 tablet_service.cc:1514] Processing DeleteTablet for tablet e64155c5cd3345df994802d747a91127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:45 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:35008
I20260811 01:42:45.357520 5635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10e4a68aa21f47e9bafafcb48525dabc: Sending DeleteTablet for 3 replicas of tablet e64155c5cd3345df994802d747a91127
I20260811 01:42:45.358217 5922 tablet_service.cc:1514] Processing DeleteTablet for tablet e64155c5cd3345df994802d747a91127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:45 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:35996
I20260811 01:42:45.358470 5921 tablet_service.cc:1514] Processing DeleteTablet for tablet e64155c5cd3345df994802d747a91127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:45 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:35996
I20260811 01:42:45.359193 6191 tablet_replica.cc:330] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: stopping tablet replica
I20260811 01:42:45.359670 6191 raft_consensus.cc:2229] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:45.359915 6190 tablet_replica.cc:330] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: stopping tablet replica
I20260811 01:42:45.360116 6070 tablet_service.cc:1514] Processing DeleteTablet for tablet e64155c5cd3345df994802d747a91127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:45 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47504
I20260811 01:42:45.360291 6191 raft_consensus.cc:2258] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:45.360364 6190 raft_consensus.cc:2229] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:45.360843 6190 raft_consensus.cc:2258] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:45.361635 6192 tablet_replica.cc:330] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: stopping tablet replica
I20260811 01:42:45.361878 5771 tablet_service.cc:1514] Processing DeleteTablet for tablet e64155c5cd3345df994802d747a91127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:45 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:35008
I20260811 01:42:45.362114 6192 raft_consensus.cc:2229] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:45.362839 6191 ts_tablet_manager.cc:1905] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:45.362835 6192 raft_consensus.cc:2258] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:45.363294 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5704
I20260811 01:42:45.365980 6192 ts_tablet_manager.cc:1905] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:45.372223 6191 ts_tablet_manager.cc:1918] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:45.372413 6191 log.cc:1196] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/e64155c5cd3345df994802d747a91127
I20260811 01:42:45.372572 6190 ts_tablet_manager.cc:1905] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:45.372961 6191 ts_tablet_manager.cc:1939] T e64155c5cd3345df994802d747a91127 P e667338ac05c4231b66b65ba06fc6f87: Deleting consensus metadata
I20260811 01:42:45.373749 6192 ts_tablet_manager.cc:1918] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:45.374019 6192 log.cc:1196] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/e64155c5cd3345df994802d747a91127
W20260811 01:42:45.375571 5621 catalog_manager.cc:4808] TS e667338ac05c4231b66b65ba06fc6f87 (127.17.132.2:33153): delete failed for tablet e64155c5cd3345df994802d747a91127 because the tablet was not found. No further retry: Not found: Tablet not found: e64155c5cd3345df994802d747a91127
I20260811 01:42:45.374687 6192 ts_tablet_manager.cc:1939] T e64155c5cd3345df994802d747a91127 P a207daf841e64c5b90012f210f800885: Deleting consensus metadata
I20260811 01:42:45.377830 5622 catalog_manager.cc:4841] TS a207daf841e64c5b90012f210f800885 (127.17.132.3:35899): tablet e64155c5cd3345df994802d747a91127 (table test-table [id=1e5ba06bf4ad43b688f277e09fd740db]) successfully deleted
I20260811 01:42:45.382426 6190 ts_tablet_manager.cc:1918] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:45.382611 6190 log.cc:1196] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/e64155c5cd3345df994802d747a91127
I20260811 01:42:45.383179 6190 ts_tablet_manager.cc:1939] T e64155c5cd3345df994802d747a91127 P fbcf3208c85c469797febe94981b8e2b: Deleting consensus metadata
Aug 11 01:42:45 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
W20260811 01:42:45.385627 5622 catalog_manager.cc:4808] TS fbcf3208c85c469797febe94981b8e2b (127.17.132.1:38047): delete failed for tablet e64155c5cd3345df994802d747a91127 because the tablet was not found. No further retry: Not found: Tablet not found: e64155c5cd3345df994802d747a91127
I20260811 01:42:45.392122 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.364409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35016 (local address 127.17.132.1:38047)
0811 01:42:45.364581 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.364588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.375649 (+ 11061us) server_negotiation.cc:407] Connection header received
0811 01:42:45.375964 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.375969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.376056 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.376139 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:45.378124 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.378897 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.380434 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.380911 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.381065 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.385996 (+ 4931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:45.386008 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:45.386022 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:45.386066 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:45.389008 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.389856 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.389873 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.389876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.390021 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.390454 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.390459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.390461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.390842 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:45.391161 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.391502 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.391747 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:42:45.392817 5836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:45.503058 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5704
I20260811 01:42:45.524893 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5852
Aug 11 01:42:45 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:42:45.543102 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.525844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.17.132.2:33153)
0811 01:42:45.526047 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.526053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.526120 (+ 67us) server_negotiation.cc:407] Connection header received
0811 01:42:45.526304 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.526312 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.526406 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.526529 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:45.527903 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.529033 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.530457 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.531096 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.531225 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.535509 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:45.535530 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:45.535553 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:45.535605 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:45.539708 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.540571 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.540582 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.540586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.540760 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.541220 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.541226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.541230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.541824 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:45.542168 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.542441 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.542694 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:42:45.543906 5987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:45.637949 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5852
I20260811 01:42:45.658608 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5998
Aug 11 01:42:45 dist-test-slave-0kls krb5kdc[5588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:42:45.675686 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:45.659436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47528 (local address 127.17.132.3:35899)
0811 01:42:45.659621 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:45.659628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:45.659740 (+ 112us) server_negotiation.cc:407] Connection header received
0811 01:42:45.659968 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:45.659974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:45.660051 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:45.660173 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:45.661560 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.662500 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.663866 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:45.664336 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:45.664477 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:45.669360 (+ 4883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:45.669374 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:45.669390 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:45.669425 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:45.672624 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.673342 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.673350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.673352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.673528 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:45.673978 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:45.673985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:45.673988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:45.674380 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:45.674751 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:45.675066 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 01:42:45.675319 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:42:45.676376 6135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:45.802774 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5998
I20260811 01:42:45.828017 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 5602
I20260811 01:42:45.829126 5669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:45.941494 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 5602
2026-08-11T01:42:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4868 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T01:42:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:46Z Disabled control of system clock
I20260811 01:42:46.044075 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36039
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:34457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:36039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:46.399820 6201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:46.400216 6201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:46.400375 6201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:46.408068 6201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:46.408259 6201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:46.408352 6201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:46.408478 6201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:46.408561 6201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:46.418838 6201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:34457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:36039
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:36039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:46.420312 6201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:46.422240 6201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:46.434929 6206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:46.434862 6207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:46.434904 6209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:46.436100 6201 server_base.cc:1034] running on GCE node
I20260811 01:42:46.436913 6201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:46.438566 6201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:46.439806 6201 hybrid_clock.cc:648] HybridClock initialized: now 1786412566439754 us; error 42 us; skew 500 ppm
I20260811 01:42:46.440171 6201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:46.442577 6201 webserver.cc:460] Webserver started at http://127.17.132.62:44727/ using document root <none> and password file <none>
I20260811 01:42:46.443302 6201 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:46.443439 6201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:46.443790 6201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:46.446928 6201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7"
format_stamp: "Formatted at 2026-08-11 01:42:46 on dist-test-slave-0kls"
server_key: "b2c34eb761c5deee9fd7d051fafe0974"
server_key_iv: "12b2648a43f438f76bd688035bd102a2"
server_key_version: "encryptionkey@0"
I20260811 01:42:46.447759 6201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7"
format_stamp: "Formatted at 2026-08-11 01:42:46 on dist-test-slave-0kls"
server_key: "b2c34eb761c5deee9fd7d051fafe0974"
server_key_iv: "12b2648a43f438f76bd688035bd102a2"
server_key_version: "encryptionkey@0"
I20260811 01:42:46.453158 6201 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:42:46.456879 6215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:46.458232 6201 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:42:46.458426 6201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7"
format_stamp: "Formatted at 2026-08-11 01:42:46 on dist-test-slave-0kls"
server_key: "b2c34eb761c5deee9fd7d051fafe0974"
server_key_iv: "12b2648a43f438f76bd688035bd102a2"
server_key_version: "encryptionkey@0"
I20260811 01:42:46.458655 6201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:46.481001 6201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:46.482043 6201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:46.482355 6201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:46.502897 6201 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:36039
I20260811 01:42:46.502918 6269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:36039 every 8 connection(s)
I20260811 01:42:46.504366 6201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:46.507027 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6201
I20260811 01:42:46.507234 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:46.507839 17936 external_mini_cluster.cc:1428] Setting key 98e9649d4beff4c4b5fdfa7bd0d4235e
I20260811 01:42:46.509855 6270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:46.524256 6274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:46.509662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35386 (local address 127.17.132.62:36039)
0811 01:42:46.510954 (+ 1292us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:46.510972 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:46.511030 (+ 58us) server_negotiation.cc:407] Connection header received
0811 01:42:46.513263 (+ 2233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:46.513294 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:46.513991 (+ 697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:46.514482 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:46.515056 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:46.517177 (+ 2121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:46.518691 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:46.519784 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:46.519978 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:46.521197 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:46.521210 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:46.521232 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:46.522071 (+ 839us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:46.522180 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:46.522207 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:46.522340 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:46.522549 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 01:42:46.522937 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":458,"threads_started":1}
I20260811 01:42:46.525318 6270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: Bootstrap starting.
I20260811 01:42:46.528527 6270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:46.529585 6270 log.cc:824] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:46.532536 6270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: No bootstrap required, opened a new log
I20260811 01:42:46.540060 6270 raft_consensus.cc:348] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.540485 6270 raft_consensus.cc:374] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:46.540596 6270 raft_consensus.cc:729] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57ebe658c9b481a8b61c01dfd3c9ff7, State: Initialized, Role: FOLLOWER
I20260811 01:42:46.541431 6270 consensus_queue.cc:260] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.541714 6276 raft_consensus.cc:482] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:46.542006 6276 raft_consensus.cc:504] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.542618 6276 leader_election.cc:302] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f57ebe658c9b481a8b61c01dfd3c9ff7; no voters:
I20260811 01:42:46.543452 6270 raft_consensus.cc:388] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:46.543510 6276 leader_election.cc:288] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260811 01:42:46.543715 6277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:46.543884 6277 raft_consensus.cc:482] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:46.544020 6277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:46.546285 6277 raft_consensus.cc:504] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.546540 6277 leader_election.cc:302] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f57ebe658c9b481a8b61c01dfd3c9ff7; no voters:
I20260811 01:42:46.546564 6270 raft_consensus.cc:482] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:46.546725 6277 leader_election.cc:288] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:46.546759 6270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:42:46.548815 6270 raft_consensus.cc:504] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.549118 6276 raft_consensus.cc:2741] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 2 FOLLOWER]: Leader election decision vote started in defunct term 1: won
I20260811 01:42:46.549271 6270 leader_election.cc:302] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f57ebe658c9b481a8b61c01dfd3c9ff7; no voters:
I20260811 01:42:46.549528 6270 leader_election.cc:288] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:42:46.549615 6277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:42:46.549901 6277 raft_consensus.cc:686] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [term 2 LEADER]: Becoming Leader. State: Replica: f57ebe658c9b481a8b61c01dfd3c9ff7, State: Running, Role: LEADER
I20260811 01:42:46.550501 6277 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } }
I20260811 01:42:46.551723 6270 sys_catalog.cc:564] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:46.552731 6276 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } } }
I20260811 01:42:46.552803 6278 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f57ebe658c9b481a8b61c01dfd3c9ff7. Latest consensus state: current_term: 2 leader_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57ebe658c9b481a8b61c01dfd3c9ff7" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 36039 } } }
I20260811 01:42:46.553140 6278 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:46.553144 6276 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:46.554332 6281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:46.559648 6281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:46.570380 6281 catalog_manager.cc:1347] Generated new cluster ID: fc77017ccfed44ef83e305e12a654ec2
I20260811 01:42:46.570528 6281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:46.589483 6281 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:46.591446 6281 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:46.609926 6281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: Generated new TSK 0
I20260811 01:42:46.610891 6281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:42:46.619911 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--builtin_ntp_servers=127.17.132.20:34457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:47.004886 6296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:47.005203 6296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:47.005293 6296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:47.012928 6296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:47.013051 6296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:47.013160 6296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:47.022485 6296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:34457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:47.024066 6296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:47.026001 6296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:47.039966 6301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:47.040051 6304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:47.039960 6302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:47.041033 6296 server_base.cc:1034] running on GCE node
I20260811 01:42:47.041750 6296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:47.042888 6296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:47.044134 6296 hybrid_clock.cc:648] HybridClock initialized: now 1786412567044072 us; error 53 us; skew 500 ppm
I20260811 01:42:47.044495 6296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:47.047109 6296 webserver.cc:460] Webserver started at http://127.17.132.1:34269/ using document root <none> and password file <none>
I20260811 01:42:47.047889 6296 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:47.048035 6296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:47.048385 6296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:47.051514 6296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "f599dcfe5ae84572a7cfabacc11052a4"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "c650c7e018dd4d53eacd42ce14b6c114"
server_key_iv: "7e80d96f9571339d155f5cc0ee8f8406"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.052403 6296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "f599dcfe5ae84572a7cfabacc11052a4"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "c650c7e018dd4d53eacd42ce14b6c114"
server_key_iv: "7e80d96f9571339d155f5cc0ee8f8406"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.058717 6296 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:42:47.062462 6312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:47.064054 6296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:47.064246 6296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "f599dcfe5ae84572a7cfabacc11052a4"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "c650c7e018dd4d53eacd42ce14b6c114"
server_key_iv: "7e80d96f9571339d155f5cc0ee8f8406"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.064481 6296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:47.082787 6296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:47.083719 6296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:47.084074 6296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:47.085150 6296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:47.086793 6296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:47.086933 6296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:47.087067 6296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:47.087163 6296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:47.122014 6296 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:37477
I20260811 01:42:47.122067 6428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:37477 every 8 connection(s)
I20260811 01:42:47.123406 6296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:47.131306 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6296
I20260811 01:42:47.131515 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:47.132040 17936 external_mini_cluster.cc:1428] Setting key ec7aedca32f76779c0e768e43e9ceb3e
I20260811 01:42:47.135164 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--builtin_ntp_servers=127.17.132.20:34457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:47.136631 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:47.125976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:35625 (local address 127.17.132.62:36039)
0811 01:42:47.126470 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:47.126475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:47.127480 (+ 1005us) server_negotiation.cc:407] Connection header received
0811 01:42:47.129273 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:47.129280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:47.129367 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:47.129490 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:47.130646 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.131704 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.133328 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.133953 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.134078 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:47.135633 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:47.135637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:47.135640 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:47.135667 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:47.135714 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:47.135726 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:47.135797 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:47.136063 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 01:42:47.136146 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":279,"threads_started":1}
I20260811 01:42:47.137979 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:47.126454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36039 (local address 127.17.132.1:35625)
0811 01:42:47.127323 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:47.127365 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:47.128997 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:47.129732 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:47.129740 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:47.129901 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:47.130474 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:47.130491 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.131857 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.131862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:47.133178 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:47.133191 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.134205 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.134213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:47.134510 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:47.135271 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:47.135275 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:47.135333 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:47.135442 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:47.135830 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:47.135844 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:47.135855 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:42:47.136047 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 01:42:47.136498 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":275,"threads_started":1}
I20260811 01:42:47.139618 6429 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36039
I20260811 01:42:47.139943 6429 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:47.140750 6429 heartbeater.cc:511] Master 127.17.132.62:36039 requested a full tablet report, sending...
I20260811 01:42:47.142880 6234 ts_manager.cc:194] Registered new tserver with Master: f599dcfe5ae84572a7cfabacc11052a4 (127.17.132.1:37477)
I20260811 01:42:47.144409 6234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.1:35625
W20260811 01:42:47.488124 6433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:47.488493 6433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:47.488662 6433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:47.496153 6433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:47.496337 6433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:47.496534 6433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:47.506326 6433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:34457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:47.507720 6433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:47.509713 6433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:47.523423 6438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:47.523484 6439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:47.523511 6442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:47.524380 6433 server_base.cc:1034] running on GCE node
I20260811 01:42:47.524922 6433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:47.525894 6433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:47.527094 6433 hybrid_clock.cc:648] HybridClock initialized: now 1786412567527030 us; error 75 us; skew 500 ppm
I20260811 01:42:47.527431 6433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:47.529619 6433 webserver.cc:460] Webserver started at http://127.17.132.2:40167/ using document root <none> and password file <none>
I20260811 01:42:47.530359 6433 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:47.530447 6433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:47.530802 6433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:47.533557 6433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "0147b5918b2144bb97e85ed82ff50b2b"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "0f222a9661ee3ab3316bf29c80051f25"
server_key_iv: "54402e3e6a413d28789dacdc6d79d51c"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.534385 6433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "0147b5918b2144bb97e85ed82ff50b2b"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "0f222a9661ee3ab3316bf29c80051f25"
server_key_iv: "54402e3e6a413d28789dacdc6d79d51c"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.539376 6433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:42:47.542778 6448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:47.544071 6433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:42:47.544247 6433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "0147b5918b2144bb97e85ed82ff50b2b"
format_stamp: "Formatted at 2026-08-11 01:42:47 on dist-test-slave-0kls"
server_key: "0f222a9661ee3ab3316bf29c80051f25"
server_key_iv: "54402e3e6a413d28789dacdc6d79d51c"
server_key_version: "encryptionkey@0"
I20260811 01:42:47.544456 6433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:47.565526 6433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:47.566450 6433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:47.566777 6433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:47.567823 6433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:47.569545 6433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:47.569682 6433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:47.569836 6433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:47.569936 6433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 01:42:47.604035 6433 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:44415
I20260811 01:42:47.604130 6567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:44415 every 8 connection(s)
I20260811 01:42:47.605404 6433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:47.609212 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6433
I20260811 01:42:47.609421 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:47.610060 17936 external_mini_cluster.cc:1428] Setting key 250800bc4bc410991b41d8b6aa2f350f
I20260811 01:42:47.613183 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--builtin_ntp_servers=127.17.132.20:34457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:47.620345 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:47.608199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:43155 (local address 127.17.132.62:36039)
0811 01:42:47.608404 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:47.608409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:47.610166 (+ 1757us) server_negotiation.cc:407] Connection header received
0811 01:42:47.612577 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:47.612583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:47.612663 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:47.612778 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:47.614095 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.615301 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.617026 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.617744 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.617907 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:47.619374 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:47.619383 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:47.619392 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:47.619418 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:47.619464 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:47.619483 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:47.619579 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:47.619820 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 01:42:47.619935 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:42:47.621371 6570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:47.608581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36039 (local address 127.17.132.2:43155)
0811 01:42:47.609961 (+ 1380us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:47.610020 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:47.612280 (+ 2260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:47.612996 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:47.613005 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:47.613136 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:47.613915 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:47.613937 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.615474 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.615478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:47.616871 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:47.616884 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:47.617986 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:47.617992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:47.618231 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:47.618987 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:47.618990 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:47.619035 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:47.619165 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:47.619589 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:47.619598 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:47.619605 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:42:47.619776 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 01:42:47.620131 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":402,"threads_started":1}
I20260811 01:42:47.623004 6568 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36039
I20260811 01:42:47.623354 6568 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:47.624308 6568 heartbeater.cc:511] Master 127.17.132.62:36039 requested a full tablet report, sending...
I20260811 01:42:47.626567 6234 ts_manager.cc:194] Registered new tserver with Master: 0147b5918b2144bb97e85ed82ff50b2b (127.17.132.2:44415)
I20260811 01:42:47.627954 6234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.2:43155
W20260811 01:42:47.987512 6571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:47.987802 6571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:47.987892 6571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:47.995390 6571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:47.995524 6571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:47.995635 6571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:48.005347 6571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:34457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:36039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:48.007382 6571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:48.010133 6571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:48.025357 6576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:48.025362 6577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:48.025287 6579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:48.026292 6571 server_base.cc:1034] running on GCE node
I20260811 01:42:48.026940 6571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:48.028023 6571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:48.029269 6571 hybrid_clock.cc:648] HybridClock initialized: now 1786412568029233 us; error 59 us; skew 500 ppm
I20260811 01:42:48.029618 6571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:48.032225 6571 webserver.cc:460] Webserver started at http://127.17.132.3:42709/ using document root <none> and password file <none>
I20260811 01:42:48.032976 6571 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:48.033114 6571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:48.033456 6571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:48.036657 6571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "11f96f6b2c3742f99bc7f5b653133b9e"
format_stamp: "Formatted at 2026-08-11 01:42:48 on dist-test-slave-0kls"
server_key: "000a845c6627dfac8212d5a6678ea334"
server_key_iv: "3f42fdf3b3f688838e09bd07b20e8759"
server_key_version: "encryptionkey@0"
I20260811 01:42:48.037494 6571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "11f96f6b2c3742f99bc7f5b653133b9e"
format_stamp: "Formatted at 2026-08-11 01:42:48 on dist-test-slave-0kls"
server_key: "000a845c6627dfac8212d5a6678ea334"
server_key_iv: "3f42fdf3b3f688838e09bd07b20e8759"
server_key_version: "encryptionkey@0"
I20260811 01:42:48.043098 6571 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:42:48.046775 6585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:48.048326 6571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:48.048528 6571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "11f96f6b2c3742f99bc7f5b653133b9e"
format_stamp: "Formatted at 2026-08-11 01:42:48 on dist-test-slave-0kls"
server_key: "000a845c6627dfac8212d5a6678ea334"
server_key_iv: "3f42fdf3b3f688838e09bd07b20e8759"
server_key_version: "encryptionkey@0"
I20260811 01:42:48.048756 6571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:48.064085 6571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:48.064898 6571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:48.065172 6571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:48.066213 6571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:48.067768 6571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:48.067858 6571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:48.067935 6571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:48.068023 6571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:48.107669 6571 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:36295
I20260811 01:42:48.107772 6703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:36295 every 8 connection(s)
I20260811 01:42:48.109112 6571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:48.111645 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6571
I20260811 01:42:48.111865 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:48.112476 17936 external_mini_cluster.cc:1428] Setting key 2a20ae764c0df586a838ff8c4da4891e
I20260811 01:42:48.122808 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.112304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:45387 (local address 127.17.132.62:36039)
0811 01:42:48.112489 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.112494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.114412 (+ 1918us) server_negotiation.cc:407] Connection header received
0811 01:42:48.116391 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.116395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.116464 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.116547 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:48.117596 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.118450 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.120003 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.120401 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.120493 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.121992 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:48.121998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:48.122002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:48.122027 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:48.122073 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:48.122093 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:48.122198 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.122459 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.122548 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:42:48.124320 6706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.113010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:36039 (local address 127.17.132.3:45387)
0811 01:42:48.114223 (+ 1213us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.114285 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.116136 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.116770 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.116778 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.116867 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:48.117447 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.117463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.118609 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.118614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.119874 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.119888 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.120609 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.120614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.120824 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.121554 (+ 730us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:48.121557 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:48.121623 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:48.121737 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:48.122211 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:48.122222 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:48.122230 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.122442 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.122945 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":386,"threads_started":1}
I20260811 01:42:48.125945 6704 heartbeater.cc:347] Connected to a master server at 127.17.132.62:36039
I20260811 01:42:48.126297 6704 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:48.127372 6704 heartbeater.cc:511] Master 127.17.132.62:36039 requested a full tablet report, sending...
I20260811 01:42:48.128969 6234 ts_manager.cc:194] Registered new tserver with Master: 11f96f6b2c3742f99bc7f5b653133b9e (127.17.132.3:36295)
I20260811 01:42:48.129748 6234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.3:45387
I20260811 01:42:48.140983 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:48.147505 6429 heartbeater.cc:503] Master 127.17.132.62:36039 was elected leader, sending a full tablet report...
I20260811 01:42:48.152204 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.145507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.17.132.62:36039)
0811 01:42:48.145866 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.145874 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.146187 (+ 313us) server_negotiation.cc:407] Connection header received
0811 01:42:48.146407 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.146411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.146478 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.146593 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:48.147132 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.147999 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.149892 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.150331 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.150432 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.151500 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:48.151504 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:48.151508 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:48.151525 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:48.151556 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:48.151567 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:48.151673 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.151859 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.151904 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 01:42:48.156648 6234 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35390:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:48.164376 6234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:48.198679 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.177280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:36295 (local address 127.0.0.1:38834)
0811 01:42:48.189564 (+ 12284us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.189589 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.189745 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.190611 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.190619 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.190654 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:48.191818 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.191839 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.193863 (+ 2024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.193870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.195782 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.195799 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.197437 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.197444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.197836 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.197902 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.198040 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.198277 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12120,"mutex_wait_us":86,"thread_start_us":10133,"threads_started":1}
I20260811 01:42:48.198670 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.178113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38834 (local address 127.17.132.3:36295)
0811 01:42:48.189077 (+ 10964us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.189089 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.189926 (+ 837us) server_negotiation.cc:407] Connection header received
0811 01:42:48.190113 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.190120 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.190340 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.191047 (+ 707us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:48.192179 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.193727 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.196054 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.197204 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.197364 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.197688 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.198088 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.198273 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10718,"thread_start_us":10549,"threads_started":1}
I20260811 01:42:48.201207 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.177085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44415 (local address 127.0.0.1:60442)
0811 01:42:48.187962 (+ 10877us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.188027 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.188267 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.190858 (+ 2591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.190863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.190886 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:48.192366 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.192381 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.194310 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.194320 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.196696 (+ 2376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.196719 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.200334 (+ 3615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.200344 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.200523 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.200565 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.200664 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.200802 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10487,"mutex_wait_us":23,"thread_start_us":12134,"threads_started":1}
I20260811 01:42:48.201402 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.177303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60442 (local address 127.17.132.2:44415)
0811 01:42:48.189921 (+ 12618us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.189930 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.189958 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:42:48.190060 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.190070 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.190341 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.190571 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:48.192607 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.194103 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.196974 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.198542 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.198692 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.198958 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.200752 (+ 1794us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.200964 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12408,"thread_start_us":12303,"threads_started":1}
I20260811 01:42:48.202140 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.178487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.17.132.1:37477)
0811 01:42:48.191451 (+ 12964us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.191462 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.192564 (+ 1102us) server_negotiation.cc:407] Connection header received
0811 01:42:48.192680 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.192691 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.192963 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.193184 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:48.193854 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.195517 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.198460 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.200256 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.200403 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.200730 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.201590 (+ 860us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.201761 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12759,"thread_start_us":12605,"threads_started":1}
I20260811 01:42:48.202170 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.177723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41594)
0811 01:42:48.192244 (+ 14521us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.192272 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.192416 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.193271 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.193275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.193300 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:48.193619 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.193630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.195728 (+ 2098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.195734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.198189 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.198207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.200874 (+ 2667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.200881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.201083 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.201127 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.201236 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.201805 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14336,"mutex_wait_us":93,"thread_start_us":14064,"threads_started":1}
I20260811 01:42:48.203492 6635 tablet_service.cc:1467] Processing CreateTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 (DEFAULT_TABLE table=test-table [id=eab9aaacf4184a6a843ea68a26c530a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:48.205193 6635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:48.205371 6499 tablet_service.cc:1467] Processing CreateTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 (DEFAULT_TABLE table=test-table [id=eab9aaacf4184a6a843ea68a26c530a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:48.205521 6363 tablet_service.cc:1467] Processing CreateTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 (DEFAULT_TABLE table=test-table [id=eab9aaacf4184a6a843ea68a26c530a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:48.206769 6499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:48.206918 6363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:48.220245 6724 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Bootstrap starting.
I20260811 01:42:48.222680 6725 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Bootstrap starting.
I20260811 01:42:48.223562 6726 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Bootstrap starting.
I20260811 01:42:48.226347 6724 tablet_bootstrap.cc:654] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:48.226495 6725 tablet_bootstrap.cc:654] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:48.227365 6726 tablet_bootstrap.cc:654] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:48.227553 6725 log.cc:824] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:48.227747 6724 log.cc:824] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:48.228645 6726 log.cc:824] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:48.230834 6724 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: No bootstrap required, opened a new log
I20260811 01:42:48.230948 6725 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: No bootstrap required, opened a new log
I20260811 01:42:48.231172 6724 ts_tablet_manager.cc:1397] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:42:48.231243 6725 ts_tablet_manager.cc:1397] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:42:48.231822 6726 tablet_bootstrap.cc:492] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: No bootstrap required, opened a new log
I20260811 01:42:48.232175 6726 ts_tablet_manager.cc:1397] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:42:48.238934 6724 raft_consensus.cc:348] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.239308 6724 raft_consensus.cc:374] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:48.239437 6724 raft_consensus.cc:729] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f599dcfe5ae84572a7cfabacc11052a4, State: Initialized, Role: FOLLOWER
I20260811 01:42:48.240149 6724 consensus_queue.cc:260] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.242858 6724 ts_tablet_manager.cc:1428] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260811 01:42:48.242523 6725 raft_consensus.cc:348] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.243067 6725 raft_consensus.cc:374] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:48.243189 6725 raft_consensus.cc:729] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0147b5918b2144bb97e85ed82ff50b2b, State: Initialized, Role: FOLLOWER
I20260811 01:42:48.243837 6725 consensus_queue.cc:260] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.244539 6726 raft_consensus.cc:348] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.245164 6726 raft_consensus.cc:374] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:48.245304 6726 raft_consensus.cc:729] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f96f6b2c3742f99bc7f5b653133b9e, State: Initialized, Role: FOLLOWER
I20260811 01:42:48.246201 6726 consensus_queue.cc:260] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.246668 6568 heartbeater.cc:503] Master 127.17.132.62:36039 was elected leader, sending a full tablet report...
I20260811 01:42:48.247372 6725 ts_tablet_manager.cc:1428] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260811 01:42:48.248351 6704 heartbeater.cc:503] Master 127.17.132.62:36039 was elected leader, sending a full tablet report...
I20260811 01:42:48.249867 6726 ts_tablet_manager.cc:1428] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Time spent starting tablet: real 0.017s user 0.011s sys 0.005s
I20260811 01:42:48.258352 6732 raft_consensus.cc:482] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:48.258587 6732 raft_consensus.cc:504] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.260218 6732 leader_election.cc:288] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0147b5918b2144bb97e85ed82ff50b2b (127.17.132.2:44415), f599dcfe5ae84572a7cfabacc11052a4 (127.17.132.1:37477)
I20260811 01:42:48.266808 6706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.260467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.17.132.3:33573)
0811 01:42:48.260927 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.260951 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.261112 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.261539 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.261543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.261577 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:48.261831 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.261845 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.262983 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.262989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.264856 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.264879 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.266275 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.266279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.266394 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.266418 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.266489 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.266583 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307}
I20260811 01:42:48.266932 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.260905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:33573 (local address 127.17.132.1:37477)
0811 01:42:48.261085 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.261092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.261115 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:42:48.261274 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.261282 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.261376 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.261480 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:48.261973 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.262843 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.265074 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.266124 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.266286 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.266358 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.266554 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.266687 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:42:48.268006 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.260571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:44415 (local address 127.17.132.3:40031)
0811 01:42:48.261493 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.261511 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:48.261694 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:48.262158 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:48.262162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:48.262186 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:48.262475 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.262483 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.263816 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.263821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.265509 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:48.265521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.267268 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.267274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:48.267455 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.267488 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:42:48.267580 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 01:42:48.267673 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":549,"threads_started":1}
I20260811 01:42:48.268046 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.260677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:40031 (local address 127.17.132.2:44415)
0811 01:42:48.260902 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.260908 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.261583 (+ 675us) server_negotiation.cc:407] Connection header received
0811 01:42:48.261897 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.261906 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.262038 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.262142 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:48.262658 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.263628 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.265699 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.266907 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.267078 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.267161 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.267638 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.267785 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:42:48.268000 6383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4a6220b00ef4b66ad985dc5a7b8dfa9" candidate_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f599dcfe5ae84572a7cfabacc11052a4" is_pre_election: true
I20260811 01:42:48.268679 6383 raft_consensus.cc:2454] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11f96f6b2c3742f99bc7f5b653133b9e in term 0.
I20260811 01:42:48.269069 6520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4a6220b00ef4b66ad985dc5a7b8dfa9" candidate_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0147b5918b2144bb97e85ed82ff50b2b" is_pre_election: true
I20260811 01:42:48.269495 6587 leader_election.cc:302] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f96f6b2c3742f99bc7f5b653133b9e, f599dcfe5ae84572a7cfabacc11052a4; no voters:
I20260811 01:42:48.269622 6520 raft_consensus.cc:2454] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11f96f6b2c3742f99bc7f5b653133b9e in term 0.
I20260811 01:42:48.269980 6732 raft_consensus.cc:2781] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:48.270128 6732 raft_consensus.cc:482] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:48.270273 6732 raft_consensus.cc:3037] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:48.272467 6732 raft_consensus.cc:504] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.273066 6732 leader_election.cc:288] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [CANDIDATE]: Term 1 election: Requested vote from peers 0147b5918b2144bb97e85ed82ff50b2b (127.17.132.2:44415), f599dcfe5ae84572a7cfabacc11052a4 (127.17.132.1:37477)
I20260811 01:42:48.273528 6520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4a6220b00ef4b66ad985dc5a7b8dfa9" candidate_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0147b5918b2144bb97e85ed82ff50b2b"
I20260811 01:42:48.273573 6383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4a6220b00ef4b66ad985dc5a7b8dfa9" candidate_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f599dcfe5ae84572a7cfabacc11052a4"
I20260811 01:42:48.273756 6520 raft_consensus.cc:3037] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:48.273765 6383 raft_consensus.cc:3037] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:48.276005 6383 raft_consensus.cc:2454] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11f96f6b2c3742f99bc7f5b653133b9e in term 1.
I20260811 01:42:48.276024 6520 raft_consensus.cc:2454] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11f96f6b2c3742f99bc7f5b653133b9e in term 1.
I20260811 01:42:48.276391 6587 leader_election.cc:302] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f96f6b2c3742f99bc7f5b653133b9e, f599dcfe5ae84572a7cfabacc11052a4; no voters:
I20260811 01:42:48.276677 6732 raft_consensus.cc:2781] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:48.277154 6732 raft_consensus.cc:686] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 1 LEADER]: Becoming Leader. State: Replica: 11f96f6b2c3742f99bc7f5b653133b9e, State: Running, Role: LEADER
I20260811 01:42:48.277696 6732 consensus_queue.cc:237] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } }
I20260811 01:42:48.282608 6234 catalog_manager.cc:5495] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 11f96f6b2c3742f99bc7f5b653133b9e (127.17.132.3). New cstate: current_term: 1 leader_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11f96f6b2c3742f99bc7f5b653133b9e" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 36295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 } health_report { overall_health: UNKNOWN } } }
I20260811 01:42:48.313722 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.308050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38850 (local address 127.17.132.3:36295)
0811 01:42:48.308254 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.308258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.308368 (+ 110us) server_negotiation.cc:407] Connection header received
0811 01:42:48.308615 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.308621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.308716 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.308854 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:48.309235 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.310051 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.311664 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.312084 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.312182 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.312706 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:48.313205 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:48.313343 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.313480 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.313520 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:42:48.322383 6520 raft_consensus.cc:1261] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 1 FOLLOWER]: Refusing update from remote peer 11f96f6b2c3742f99bc7f5b653133b9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:48.322383 6383 raft_consensus.cc:1261] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 1 FOLLOWER]: Refusing update from remote peer 11f96f6b2c3742f99bc7f5b653133b9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:48.323444 6734 consensus_queue.cc:1035] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0147b5918b2144bb97e85ed82ff50b2b" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 44415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:48.323835 6732 consensus_queue.cc:1035] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f599dcfe5ae84572a7cfabacc11052a4" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 37477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:48.336246 6738 mvcc.cc:205] Tried to move back new op lower bound from 7317145879838121984 to 7317145879669776384. Current Snapshot: MvccSnapshot[applied={T|T < 7317145879838121984}]
I20260811 01:42:48.355938 6233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:48.356298 6233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35390:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:48.360216 6233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f57ebe658c9b481a8b61c01dfd3c9ff7: Sending DeleteTablet for 3 replicas of tablet e4a6220b00ef4b66ad985dc5a7b8dfa9
I20260811 01:42:48.361371 6499 tablet_service.cc:1514] Processing DeleteTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:48 UTC) from {username='slave'} at 127.0.0.1:60442
I20260811 01:42:48.361410 6635 tablet_service.cc:1514] Processing DeleteTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:48 UTC) from {username='slave'} at 127.0.0.1:38834
I20260811 01:42:48.362433 6363 tablet_service.cc:1514] Processing DeleteTablet for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:48 UTC) from {username='slave'} at 127.0.0.1:41594
I20260811 01:42:48.364508 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6296
I20260811 01:42:48.384353 6749 tablet_replica.cc:330] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: stopping tablet replica
I20260811 01:42:48.384538 6750 tablet_replica.cc:330] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: stopping tablet replica
I20260811 01:42:48.385075 6750 raft_consensus.cc:2229] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:48.385695 6750 raft_consensus.cc:2258] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:48.387034 6749 raft_consensus.cc:2229] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:48.388552 6750 ts_tablet_manager.cc:1905] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P f599dcfe5ae84572a7cfabacc11052a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:48.389488 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.365973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.17.132.1:37477)
0811 01:42:48.366174 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.366181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.377536 (+ 11355us) server_negotiation.cc:407] Connection header received
0811 01:42:48.378212 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.378221 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.378392 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.378493 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:48.379361 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.380982 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.384626 (+ 3644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.385399 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.385501 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.387669 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:48.387681 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:48.387708 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:48.388443 (+ 735us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:48.388503 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:48.388530 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:48.388633 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.388995 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.389123 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:42:48.390688 6749 raft_consensus.cc:2258] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:48.392004 6424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:48.393769 6748 tablet_replica.cc:330] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: stopping tablet replica
I20260811 01:42:48.394104 6749 ts_tablet_manager.cc:1905] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:48.394305 6748 raft_consensus.cc:2229] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:48.394973 6748 raft_consensus.cc:2258] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:48.396989 6748 ts_tablet_manager.cc:1905] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:48.402020 6749 ts_tablet_manager.cc:1918] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:48.402227 6749 log.cc:1196] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/e4a6220b00ef4b66ad985dc5a7b8dfa9
I20260811 01:42:48.402801 6749 ts_tablet_manager.cc:1939] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 11f96f6b2c3742f99bc7f5b653133b9e: Deleting consensus metadata
I20260811 01:42:48.404258 6748 ts_tablet_manager.cc:1918] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:48.404445 6748 log.cc:1196] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/e4a6220b00ef4b66ad985dc5a7b8dfa9
I20260811 01:42:48.404809 6216 catalog_manager.cc:4841] TS 11f96f6b2c3742f99bc7f5b653133b9e (127.17.132.3:36295): tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 (table test-table [id=eab9aaacf4184a6a843ea68a26c530a5]) successfully deleted
I20260811 01:42:48.405009 6748 ts_tablet_manager.cc:1939] T e4a6220b00ef4b66ad985dc5a7b8dfa9 P 0147b5918b2144bb97e85ed82ff50b2b: Deleting consensus metadata
I20260811 01:42:48.406649 6218 catalog_manager.cc:4841] TS 0147b5918b2144bb97e85ed82ff50b2b (127.17.132.2:44415): tablet e4a6220b00ef4b66ad985dc5a7b8dfa9 (table test-table [id=eab9aaacf4184a6a843ea68a26c530a5]) successfully deleted
I20260811 01:42:48.493337 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6296
W20260811 01:42:48.522449 6217 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:37477 (error 108)
I20260811 01:42:48.522775 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6433
I20260811 01:42:48.525333 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.524529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41612)
0811 01:42:48.524779 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.524996 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 01:42:48.525724 6217 catalog_manager.cc:4584] TS f599dcfe5ae84572a7cfabacc11052a4 (127.17.132.1:37477): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4a6220b00ef4b66ad985dc5a7b8dfa9: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
I20260811 01:42:48.531540 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.524033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.17.132.2:44415)
0811 01:42:48.524217 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.524222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.524242 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:42:48.524310 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.524315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.524440 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.524559 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:48.525219 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.526443 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.527779 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.528431 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.528592 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.529640 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:48.529653 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:48.529672 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:48.530725 (+ 1053us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:48.530789 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:48.530816 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:48.530944 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.531030 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.531150 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:42:48.532420 6563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:48.579888 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.579233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41626)
0811 01:42:48.579514 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.579654 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 01:42:48.581157 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.580736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41632)
0811 01:42:48.580910 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.581012 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 01:42:48.624181 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6433
I20260811 01:42:48.641680 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.641197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41644)
0811 01:42:48.641431 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.641515 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 01:42:48.642823 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.642465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41650)
0811 01:42:48.642619 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.642705 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 01:42:48.651746 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6571
I20260811 01:42:48.659848 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.652610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38862 (local address 127.17.132.3:36295)
0811 01:42:48.652860 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:48.652864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:48.653148 (+ 284us) server_negotiation.cc:407] Connection header received
0811 01:42:48.653386 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:48.653394 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:48.653506 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:48.653630 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:48.654085 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.654976 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.656351 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:48.656894 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:48.657042 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:48.658389 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:48.658398 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:48.658415 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:48.659039 (+ 624us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:48.659090 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:48.659112 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:48.659268 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:48.659365 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:42:48.659470 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 01:42:48.660529 6699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:48.723551 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.723024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41652)
0811 01:42:48.723279 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.723400 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 01:42:48.724814 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.724338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41660)
0811 01:42:48.724579 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.724658 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 01:42:48.789026 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6571
I20260811 01:42:48.816797 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6201
I20260811 01:42:48.818187 6265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:48.937597 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6201
I20260811 01:42:48.937716 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:48.936285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:37477 (local address 127.0.0.1:41662)
0811 01:42:48.936923 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:48.937057 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:37477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462}
2026-08-11T01:42:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2995 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:42:49 dist-test-slave-0kls krb5kdc[6759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:42:49 dist-test-slave-0kls krb5kdc[6759](info): set up 2 sockets
Aug 11 01:42:49 dist-test-slave-0kls krb5kdc[6759](info): commencing operation
krb5kdc: starting...
W20260811 01:42:50.154247 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:42:50 dist-test-slave-0kls krb5kdc[6759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:42:50.497567 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44339
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:44339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:50.864750 6772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:50.865064 6772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:50.865173 6772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:50.872743 6772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:50.872865 6772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:50.872915 6772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:50.872974 6772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:50.873018 6772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:50.883649 6772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:44339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:44339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:50.885000 6772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:50.886317 6772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:50.899181 6781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:50.899230 6779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:50.899341 6777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:50.900553 6772 server_base.cc:1034] running on GCE node
I20260811 01:42:50.901376 6772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:50.902911 6772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:50.904145 6772 hybrid_clock.cc:648] HybridClock initialized: now 1786412570904099 us; error 28 us; skew 500 ppm
I20260811 01:42:50.904541 6772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:50 dist-test-slave-0kls krb5kdc[6759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:50.908039 6772 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:42:50.909837 6772 webserver.cc:460] Webserver started at http://127.17.132.62:39747/ using document root <none> and password file <none>
I20260811 01:42:50.910629 6772 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:50.910799 6772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:50.911168 6772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:50.914497 6772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "4e9037016c8140ee985284332755af55"
format_stamp: "Formatted at 2026-08-11 01:42:50 on dist-test-slave-0kls"
server_key: "cef6e79e46a9c1c70b6a87b14799b1ad"
server_key_iv: "05526a33f7fd5cb5548762d52ae59fa6"
server_key_version: "encryptionkey@0"
I20260811 01:42:50.915316 6772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "4e9037016c8140ee985284332755af55"
format_stamp: "Formatted at 2026-08-11 01:42:50 on dist-test-slave-0kls"
server_key: "cef6e79e46a9c1c70b6a87b14799b1ad"
server_key_iv: "05526a33f7fd5cb5548762d52ae59fa6"
server_key_version: "encryptionkey@0"
I20260811 01:42:50.920758 6772 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:42:50.924289 6788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:50.925567 6772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:50.925779 6772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "4e9037016c8140ee985284332755af55"
format_stamp: "Formatted at 2026-08-11 01:42:50 on dist-test-slave-0kls"
server_key: "cef6e79e46a9c1c70b6a87b14799b1ad"
server_key_iv: "05526a33f7fd5cb5548762d52ae59fa6"
server_key_version: "encryptionkey@0"
I20260811 01:42:50.926045 6772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:50.946762 6772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:50.951670 6772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:50.952009 6772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:50.972345 6772 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:44339
I20260811 01:42:50.972384 6847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:44339 every 8 connection(s)
I20260811 01:42:50.973903 6772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:50.977823 6848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:50.983131 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6772
I20260811 01:42:50.983356 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:50.983846 17936 external_mini_cluster.cc:1428] Setting key e4dccdb46c83ebed2140ad9b6db39b87
I20260811 01:42:50.990233 6848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: Bootstrap starting.
I20260811 01:42:50.994118 6848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:50.995515 6848 log.cc:824] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:50.999045 6848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: No bootstrap required, opened a new log
Aug 11 01:42:50 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:51.010426 6848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } }
I20260811 01:42:51.010987 6848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:51.011119 6848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9037016c8140ee985284332755af55, State: Initialized, Role: FOLLOWER
I20260811 01:42:51.011514 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:50.985829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46526 (local address 127.17.132.62:44339)
0811 01:42:50.986711 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:50.986731 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:50.986784 (+ 53us) server_negotiation.cc:407] Connection header received
0811 01:42:50.989230 (+ 2446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:50.989261 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:50.989809 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:50.990270 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:50.991757 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:50.993823 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:50.995868 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:50.996808 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:50.997057 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:51.001366 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:51.001378 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:51.001400 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:51.001465 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:51.005978 (+ 4513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:51.006939 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:51.006951 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:51.006963 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:51.007218 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:51.007706 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:51.007711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:51.007715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:51.008631 (+ 916us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:51.008987 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:51.009415 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 01:42:51.009975 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":330,"threads_started":1}
I20260811 01:42:51.011845 6848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } }
I20260811 01:42:51.012159 6848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:51.012316 6848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:51.012513 6848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:51.015762 6848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } }
I20260811 01:42:51.016405 6848 leader_election.cc:302] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e9037016c8140ee985284332755af55; no voters:
I20260811 01:42:51.017069 6848 leader_election.cc:288] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:51.017222 6853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:51.018119 6853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [term 1 LEADER]: Becoming Leader. State: Replica: 4e9037016c8140ee985284332755af55, State: Running, Role: LEADER
I20260811 01:42:51.018734 6853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } }
I20260811 01:42:51.019742 6848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:51.022102 6854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e9037016c8140ee985284332755af55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } } }
I20260811 01:42:51.022127 6855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e9037016c8140ee985284332755af55. Latest consensus state: current_term: 1 leader_uuid: "4e9037016c8140ee985284332755af55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e9037016c8140ee985284332755af55" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 44339 } } }
I20260811 01:42:51.022594 6854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:51.022706 6855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:51.023479 6858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:51.029124 6858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:51.038367 6858 catalog_manager.cc:1347] Generated new cluster ID: 3613db9c535f4715881307aecb69c8b9
I20260811 01:42:51.038506 6858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:51.051813 6858 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:51.053179 6858 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:51.060925 6858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: Generated new TSK 0
I20260811 01:42:51.062141 6858 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.132.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
Entry for principal kudu/127.17.132.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab.
I20260811 01:42:51.145552 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:51.513419 6874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:51.513731 6874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:51.513906 6874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:51.521507 6874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:51.521624 6874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:51.521744 6874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:51.532668 6874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.1.keytab
--principal=kudu/127.17.132.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:51.534039 6874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:51.535326 6874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:51.549530 6883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:51.549487 6879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:51.549496 6881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:51.550508 6874 server_base.cc:1034] running on GCE node
I20260811 01:42:51.551226 6874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:51.552240 6874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:51.553498 6874 hybrid_clock.cc:648] HybridClock initialized: now 1786412571553445 us; error 40 us; skew 500 ppm
I20260811 01:42:51.553900 6874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:51 dist-test-slave-0kls krb5kdc[6759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412571, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:51.557204 6874 init.cc:377] Logged in from keytab as kudu/127.17.132.1@KRBTEST.COM (short username kudu)
I20260811 01:42:51.558769 6874 webserver.cc:460] Webserver started at http://127.17.132.1:45643/ using document root <none> and password file <none>
I20260811 01:42:51.559468 6874 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:51.559598 6874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:51.560001 6874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:51.563122 6874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "101004c20d8648cd8782abb7cab38797"
format_stamp: "Formatted at 2026-08-11 01:42:51 on dist-test-slave-0kls"
server_key: "b0531b9fc572b4a0209331444eb6df96"
server_key_iv: "3296a312241566404bc5d902f15ddea5"
server_key_version: "encryptionkey@0"
I20260811 01:42:51.563886 6874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "101004c20d8648cd8782abb7cab38797"
format_stamp: "Formatted at 2026-08-11 01:42:51 on dist-test-slave-0kls"
server_key: "b0531b9fc572b4a0209331444eb6df96"
server_key_iv: "3296a312241566404bc5d902f15ddea5"
server_key_version: "encryptionkey@0"
I20260811 01:42:51.569403 6874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:42:51.573493 6890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:51.575150 6874 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:42:51.575373 6874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "101004c20d8648cd8782abb7cab38797"
format_stamp: "Formatted at 2026-08-11 01:42:51 on dist-test-slave-0kls"
server_key: "b0531b9fc572b4a0209331444eb6df96"
server_key_iv: "3296a312241566404bc5d902f15ddea5"
server_key_version: "encryptionkey@0"
I20260811 01:42:51.575641 6874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:51.604837 6874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:51.609736 6874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:51.610086 6874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:51.611179 6874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:51.612654 6874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:51.612732 6874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:51.612897 6874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:51.612985 6874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:51.649894 6874 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42179
I20260811 01:42:51.650024 7011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42179 every 8 connection(s)
I20260811 01:42:51.651383 6874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:51.660858 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 6874
I20260811 01:42:51.661060 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:51.661512 17936 external_mini_cluster.cc:1428] Setting key 9a7931b5ef589e8a0ab91b6e649cf5bc
Aug 11 01:42:51 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412571, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.1@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:51.672636 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:51.654073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:42181 (local address 127.17.132.62:44339)
0811 01:42:51.654570 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:51.654574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:51.655464 (+ 890us) server_negotiation.cc:407] Connection header received
0811 01:42:51.657590 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:51.657595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:51.657709 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:51.657853 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:51.659418 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:51.660189 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:51.661994 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:51.662510 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:51.662646 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:51.666692 (+ 4046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:51.666700 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:51.666703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:51.666737 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:51.669323 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:51.670226 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:51.670231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:51.670233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:51.670352 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:51.670825 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:51.670829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:51.670831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:51.671099 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:51.671269 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:51.672021 (+ 752us) server_negotiation.cc:299] Negotiation successful
0811 01:42:51.672267 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":270,"threads_started":1}
I20260811 01:42:51.673672 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:51.654582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44339 (local address 127.17.132.1:42181)
0811 01:42:51.655292 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:51.655330 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:51.657303 (+ 1973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:51.658102 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:51.658112 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:51.658641 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:51.659241 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:51.659257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:51.660378 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:51.660382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:51.661855 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:51.661867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:51.662782 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:51.662790 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:51.663081 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:51.663863 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:51.663888 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:51.666425 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:51.669478 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:51.669488 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:51.669505 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:51.670074 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:51.670479 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:51.670485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:51.670488 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:51.670688 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:51.671235 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:51.671243 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:51.671616 (+ 373us) client_negotiation.cc:769] Sending connection context
0811 01:42:51.671900 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 01:42:51.672455 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":275,"threads_started":1}
I20260811 01:42:51.675433 7012 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44339
I20260811 01:42:51.675766 7012 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:51.676486 7012 heartbeater.cc:511] Master 127.17.132.62:44339 requested a full tablet report, sending...
I20260811 01:42:51.678727 6808 ts_manager.cc:194] Registered new tserver with Master: 101004c20d8648cd8782abb7cab38797 (127.17.132.1:42179)
I20260811 01:42:51.680447 6808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.1@KRBTEST.COM'} at 127.17.132.1:42181
WARNING: no policy specified for kudu/127.17.132.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
Entry for principal kudu/127.17.132.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab.
I20260811 01:42:51.733536 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:52.092841 7018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:52.093134 7018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:52.093300 7018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:52.100965 7018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:52.101096 7018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:52.101296 7018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:52.111737 7018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.2.keytab
--principal=kudu/127.17.132.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:52.113150 7018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:52.114508 7018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:52.128775 7026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:52.128878 7023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:52.128878 7024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:52.129144 7018 server_base.cc:1034] running on GCE node
I20260811 01:42:52.130263 7018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:52.131274 7018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:52.132477 7018 hybrid_clock.cc:648] HybridClock initialized: now 1786412572132433 us; error 31 us; skew 500 ppm
I20260811 01:42:52.132814 7018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:52 dist-test-slave-0kls krb5kdc[6759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412572, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:52.136076 7018 init.cc:377] Logged in from keytab as kudu/127.17.132.2@KRBTEST.COM (short username kudu)
I20260811 01:42:52.137676 7018 webserver.cc:460] Webserver started at http://127.17.132.2:37307/ using document root <none> and password file <none>
I20260811 01:42:52.138412 7018 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:52.138568 7018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:52.138902 7018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:52.142084 7018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "021f30d0ce4a6d9f382e74a42342dec1"
server_key_iv: "861baad8bc18fff231b9d0b4c896d5df"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.142876 7018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "021f30d0ce4a6d9f382e74a42342dec1"
server_key_iv: "861baad8bc18fff231b9d0b4c896d5df"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.148109 7018 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:42:52.151618 7033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.152976 7018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:52.153190 7018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "021f30d0ce4a6d9f382e74a42342dec1"
server_key_iv: "861baad8bc18fff231b9d0b4c896d5df"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.153475 7018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:52.170971 7018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:52.175644 7018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:52.175974 7018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:52.177088 7018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:52.178675 7018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:52.178781 7018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.178956 7018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:52.179028 7018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.214722 7018 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:35575
I20260811 01:42:52.214815 7152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:35575 every 8 connection(s)
I20260811 01:42:52.216122 7018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:52.218004 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7018
I20260811 01:42:52.218230 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:52.218743 17936 external_mini_cluster.cc:1428] Setting key 28351afae46047b512045e8e0968f4eb
Aug 11 01:42:52 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412572, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.2@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:52.239880 7155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.219191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:47977 (local address 127.17.132.62:44339)
0811 01:42:52.219812 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.219817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.221880 (+ 2063us) server_negotiation.cc:407] Connection header received
0811 01:42:52.223212 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.223217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.223313 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.223449 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:52.225108 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.225947 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.227600 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.228059 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.228217 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.232475 (+ 4258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:52.232480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:52.232484 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:52.232553 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:52.236161 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.237081 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.237087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.237091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.237250 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.237749 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.237755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.237759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.238140 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:52.238311 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.239167 (+ 856us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.239440 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":253,"threads_started":1}
I20260811 01:42:52.241003 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.219937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44339 (local address 127.17.132.2:47977)
0811 01:42:52.220974 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:52.221024 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:52.222916 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:52.223728 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:52.223738 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:52.224298 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:52.224902 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.224920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.226152 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.226156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.227430 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.227443 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.228320 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.228328 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.228593 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.229352 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:52.229377 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:52.232174 (+ 2797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:52.236354 (+ 4180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:52.236374 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:52.236392 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:52.236926 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:52.237386 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:52.237391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:52.237395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:52.237621 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:52.238284 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:52.238293 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:52.238759 (+ 466us) client_negotiation.cc:769] Sending connection context
0811 01:42:52.239062 (+ 303us) client_negotiation.cc:240] Negotiation successful
0811 01:42:52.239694 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":498,"threads_started":1}
I20260811 01:42:52.242806 7153 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44339
I20260811 01:42:52.243180 7153 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:52.244231 7153 heartbeater.cc:511] Master 127.17.132.62:44339 requested a full tablet report, sending...
I20260811 01:42:52.246248 6808 ts_manager.cc:194] Registered new tserver with Master: f44a0bd88fdb48edb6d6885f7ed5dd76 (127.17.132.2:35575)
I20260811 01:42:52.247659 6808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.2@KRBTEST.COM'} at 127.17.132.2:47977
WARNING: no policy specified for kudu/127.17.132.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
Entry for principal kudu/127.17.132.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab.
I20260811 01:42:52.298377 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:52.651101 7159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:52.651404 7159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:52.651587 7159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:52.659510 7159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:52.659649 7159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:52.659830 7159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:52.669584 7159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.3.keytab
--principal=kudu/127.17.132.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:44339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:52.670898 7159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:52.672236 7159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:42:52.683462 7012 heartbeater.cc:503] Master 127.17.132.62:44339 was elected leader, sending a full tablet report...
W20260811 01:42:52.685552 7164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:52.685592 7167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:52.685500 7165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:52.687258 7159 server_base.cc:1034] running on GCE node
I20260811 01:42:52.687783 7159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:52.688622 7159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:52.689921 7159 hybrid_clock.cc:648] HybridClock initialized: now 1786412572689883 us; error 37 us; skew 500 ppm
I20260811 01:42:52.690253 7159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:52 dist-test-slave-0kls krb5kdc[6759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412572, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:52.693223 7159 init.cc:377] Logged in from keytab as kudu/127.17.132.3@KRBTEST.COM (short username kudu)
I20260811 01:42:52.694710 7159 webserver.cc:460] Webserver started at http://127.17.132.3:34961/ using document root <none> and password file <none>
I20260811 01:42:52.695384 7159 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:52.695539 7159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:52.695878 7159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:52.698961 7159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "5e859643b61d409a94ffee019573c5ee"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "c75c69d3ebca3b6a3f8a45b1f9dd7786"
server_key_iv: "488ccda3229d1e6724cb362921cb5e5c"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.699733 7159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "5e859643b61d409a94ffee019573c5ee"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "c75c69d3ebca3b6a3f8a45b1f9dd7786"
server_key_iv: "488ccda3229d1e6724cb362921cb5e5c"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.704845 7159 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:42:52.708381 7174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.709643 7159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:42:52.709867 7159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "5e859643b61d409a94ffee019573c5ee"
format_stamp: "Formatted at 2026-08-11 01:42:52 on dist-test-slave-0kls"
server_key: "c75c69d3ebca3b6a3f8a45b1f9dd7786"
server_key_iv: "488ccda3229d1e6724cb362921cb5e5c"
server_key_version: "encryptionkey@0"
I20260811 01:42:52.710127 7159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:52.744999 7159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:52.749423 7159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:52.749835 7159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:52.750905 7159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:52.752455 7159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:52.752575 7159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.752743 7159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:52.752832 7159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:52.788594 7159 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:42637
I20260811 01:42:52.788688 7293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:42637 every 8 connection(s)
I20260811 01:42:52.790022 7159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:52.792176 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7159
I20260811 01:42:52.792385 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:52.792920 17936 external_mini_cluster.cc:1428] Setting key ed7643f9c1e0114015a06f9bd3f75dac
Aug 11 01:42:52 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412572, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.3@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:42:52.811681 7296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.792900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:44077 (local address 127.17.132.62:44339)
0811 01:42:52.793430 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.793435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.794723 (+ 1288us) server_negotiation.cc:407] Connection header received
0811 01:42:52.796896 (+ 2173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.796900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.796985 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.797082 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:52.798713 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.799494 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.801164 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.801560 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.801667 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.805293 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:52.805298 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:52.805302 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:52.805338 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:52.808831 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.809573 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.809576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.809578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.809709 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.810160 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.810164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.810166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.810422 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:52.810558 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.811221 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.811388 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":228,"threads_started":1}
I20260811 01:42:52.812721 7297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.793582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:44339 (local address 127.17.132.3:44077)
0811 01:42:52.794557 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:52.794616 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:52.796642 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:52.797302 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:52.797310 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:52.797948 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:52.798543 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.798563 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.799689 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.799693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.801009 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.801029 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.801770 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.801775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.802035 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.802725 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:42:52.802749 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:52.805039 (+ 2290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:52.808973 (+ 3934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:52.808980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:52.808995 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:52.809464 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:52.809853 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:42:52.809860 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:42:52.809868 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:42:52.810052 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:42:52.810548 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:52.810554 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:52.810881 (+ 327us) client_negotiation.cc:769] Sending connection context
0811 01:42:52.811111 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 01:42:52.811533 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":456,"threads_started":1}
I20260811 01:42:52.814183 7294 heartbeater.cc:347] Connected to a master server at 127.17.132.62:44339
I20260811 01:42:52.814524 7294 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:52.815332 7294 heartbeater.cc:511] Master 127.17.132.62:44339 requested a full tablet report, sending...
I20260811 01:42:52.816817 6808 ts_manager.cc:194] Registered new tserver with Master: 5e859643b61d409a94ffee019573c5ee (127.17.132.3:42637)
I20260811 01:42:52.817584 6808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.132.3@KRBTEST.COM'} at 127.17.132.3:44077
I20260811 01:42:52.821063 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:52.840992 7296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.825392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46536 (local address 127.17.132.62:44339)
0811 01:42:52.825563 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.825567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.826130 (+ 563us) server_negotiation.cc:407] Connection header received
0811 01:42:52.826276 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.826280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.826342 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.826424 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:52.827824 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.828555 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.830558 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.831310 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.831457 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.834642 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:52.834647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:52.834650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:52.834685 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:52.838271 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.839082 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.839086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.839088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.839223 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:52.839544 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:52.839547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:52.839549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:52.840012 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:52.840289 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.840552 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.840740 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:42:52.845153 6808 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:52.852380 6808 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:52.876910 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.867789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47054 (local address 127.17.132.2:35575)
0811 01:42:52.869632 (+ 1843us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.869640 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.869666 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:42:52.869769 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.869777 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.870019 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.870230 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:52.871021 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.872155 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.874804 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.875741 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.875902 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876110 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.876399 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.876563 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1695,"thread_start_us":1592,"threads_started":1}
I20260811 01:42:52.877274 7311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.867502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:35575 (local address 127.0.0.1:47054)
0811 01:42:52.868150 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:52.868175 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:52.868325 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:52.870471 (+ 2146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:52.870476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:52.870498 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:52.870848 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.870858 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.872309 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.872318 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.874655 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.874665 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.875953 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.875960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.876146 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876203 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 01:42:52.876336 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 01:42:52.876540 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":24,"thread_start_us":327,"threads_started":1}
I20260811 01:42:52.877696 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.865410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43390 (local address 127.17.132.3:42637)
0811 01:42:52.866810 (+ 1400us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.866816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.868157 (+ 1341us) server_negotiation.cc:407] Connection header received
0811 01:42:52.868477 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.868486 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.868740 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.868908 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:52.870142 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.871760 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.874604 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.876015 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.876167 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876383 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.877173 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.877345 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1238,"thread_start_us":1090,"threads_started":1}
I20260811 01:42:52.878566 7307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.865070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:42637 (local address 127.0.0.1:43390)
0811 01:42:52.868060 (+ 2990us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:52.868076 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:52.868252 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:52.869230 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:52.869237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:52.869287 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:52.869937 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.869951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.871948 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.871952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.874392 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.874407 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.876564 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.876577 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.876859 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876988 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 01:42:52.877969 (+ 981us) client_negotiation.cc:240] Negotiation successful
0811 01:42:52.878110 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2182,"mutex_wait_us":164,"spinlock_wait_cycles":3840,"thread_start_us":2038,"threads_started":1}
I20260811 01:42:52.878818 7310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.866046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.17.132.1:42179)
0811 01:42:52.867566 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:52.867577 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:52.868061 (+ 484us) server_negotiation.cc:407] Connection header received
0811 01:42:52.868478 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:52.868486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:52.868761 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:52.868908 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:52.870055 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.871753 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.874526 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.876025 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.876164 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876387 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:52.877172 (+ 785us) server_negotiation.cc:299] Negotiation successful
0811 01:42:52.877343 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1334,"thread_start_us":1597,"threads_started":1}
I20260811 01:42:52.879590 7308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.865379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42179 (local address 127.0.0.1:59104)
0811 01:42:52.867917 (+ 2538us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:52.867959 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:52.868226 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:52.869230 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:52.869237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:52.869279 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:52.869778 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.869822 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.871908 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.871913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.874377 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:52.874390 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:52.876591 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:52.876596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:52.876855 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:52.876988 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 01:42:52.879019 (+ 2031us) client_negotiation.cc:240] Negotiation successful
0811 01:42:52.879160 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2317,"mutex_wait_us":366,"spinlock_wait_cycles":1408,"thread_start_us":908,"threads_started":1}
I20260811 01:42:52.881281 7083 tablet_service.cc:1467] Processing CreateTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (DEFAULT_TABLE table=test-table [id=7919dcca434e4eadb4942721d9d641ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:52.881723 7224 tablet_service.cc:1467] Processing CreateTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (DEFAULT_TABLE table=test-table [id=7919dcca434e4eadb4942721d9d641ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:52.882752 7083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e78d34cf3ef4549a159b3b87c08f4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:52.883071 7224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e78d34cf3ef4549a159b3b87c08f4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:52.885214 6941 tablet_service.cc:1467] Processing CreateTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (DEFAULT_TABLE table=test-table [id=7919dcca434e4eadb4942721d9d641ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:52.886539 6941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e78d34cf3ef4549a159b3b87c08f4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:52.894568 7313 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Bootstrap starting.
I20260811 01:42:52.897938 7314 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Bootstrap starting.
I20260811 01:42:52.899111 7313 tablet_bootstrap.cc:654] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:52.900524 7313 log.cc:824] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:52.901674 7315 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Bootstrap starting.
I20260811 01:42:52.901839 7314 tablet_bootstrap.cc:654] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:52.903127 7314 log.cc:824] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:52.905629 7315 tablet_bootstrap.cc:654] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:52.905692 7313 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: No bootstrap required, opened a new log
I20260811 01:42:52.905997 7313 ts_tablet_manager.cc:1397] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 01:42:52.906350 7314 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: No bootstrap required, opened a new log
I20260811 01:42:52.906632 7314 ts_tablet_manager.cc:1397] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 01:42:52.906915 7315 log.cc:824] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:52.910027 7315 tablet_bootstrap.cc:492] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: No bootstrap required, opened a new log
I20260811 01:42:52.910318 7315 ts_tablet_manager.cc:1397] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260811 01:42:52.913868 7313 raft_consensus.cc:348] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.914305 7313 raft_consensus.cc:374] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:52.914420 7313 raft_consensus.cc:729] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e859643b61d409a94ffee019573c5ee, State: Initialized, Role: FOLLOWER
I20260811 01:42:52.915122 7313 consensus_queue.cc:260] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.917450 7314 raft_consensus.cc:348] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.917959 7314 raft_consensus.cc:374] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:52.918071 7314 raft_consensus.cc:729] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44a0bd88fdb48edb6d6885f7ed5dd76, State: Initialized, Role: FOLLOWER
I20260811 01:42:52.918704 7314 consensus_queue.cc:260] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.920118 7153 heartbeater.cc:503] Master 127.17.132.62:44339 was elected leader, sending a full tablet report...
I20260811 01:42:52.920873 7314 ts_tablet_manager.cc:1428] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260811 01:42:52.922202 7294 heartbeater.cc:503] Master 127.17.132.62:44339 was elected leader, sending a full tablet report...
I20260811 01:42:52.922927 7313 ts_tablet_manager.cc:1428] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260811 01:42:52.922679 7315 raft_consensus.cc:348] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.923131 7315 raft_consensus.cc:374] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:52.923236 7315 raft_consensus.cc:729] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101004c20d8648cd8782abb7cab38797, State: Initialized, Role: FOLLOWER
I20260811 01:42:52.923862 7315 consensus_queue.cc:260] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.925735 7315 ts_tablet_manager.cc:1428] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260811 01:42:52.968307 7154 tablet.cc:2369] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:52.997455 7320 raft_consensus.cc:482] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:52.997867 7320 raft_consensus.cc:504] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:52.999627 7320 leader_election.cc:288] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e859643b61d409a94ffee019573c5ee (127.17.132.3:42637), 101004c20d8648cd8782abb7cab38797 (127.17.132.1:42179)
I20260811 01:42:53.006752 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.000059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:37197 (local address 127.17.132.3:42637)
0811 01:42:53.000291 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.000297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.001017 (+ 720us) server_negotiation.cc:407] Connection header received
0811 01:42:53.001214 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.001222 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.001312 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.001391 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:53.002147 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.002964 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.004936 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.005718 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.005930 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.006024 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.006352 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.006483 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:42:53.006773 7310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.000197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:58125 (local address 127.17.132.1:42179)
0811 01:42:53.000410 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.000419 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.001113 (+ 694us) server_negotiation.cc:407] Connection header received
0811 01:42:53.001308 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.001312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.001404 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.001494 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:53.002268 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.002971 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.004958 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.005736 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.005988 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.006063 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.006392 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.006515 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:42:53.006953 7322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.999960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42179 (local address 127.17.132.2:58125)
0811 01:42:53.000980 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:53.001001 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:53.001173 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:53.001546 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:53.001553 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:53.001608 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:53.002096 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:53.002111 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.003121 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.003129 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:53.004766 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:53.004779 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.006028 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.006037 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:53.006204 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.006229 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:42:53.006342 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 01:42:53.006472 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":899,"mutex_wait_us":22,"thread_start_us":556,"threads_started":1}
I20260811 01:42:53.007333 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:52.999917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:42637 (local address 127.17.132.2:37197)
0811 01:42:53.000893 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:53.000909 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:53.001038 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:53.001443 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:53.001451 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:53.001482 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:53.001972 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:53.001986 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.003112 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.003119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:53.004759 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:53.004772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.005992 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.005999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:53.006189 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.006215 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:42:53.006291 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 01:42:53.006453 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"mutex_wait_us":64,"thread_start_us":657,"threads_started":1}
I20260811 01:42:53.008111 6962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e78d34cf3ef4549a159b3b87c08f4e7" candidate_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "101004c20d8648cd8782abb7cab38797" is_pre_election: true
I20260811 01:42:53.008333 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e78d34cf3ef4549a159b3b87c08f4e7" candidate_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e859643b61d409a94ffee019573c5ee" is_pre_election: true
I20260811 01:42:53.008700 6962 raft_consensus.cc:2454] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44a0bd88fdb48edb6d6885f7ed5dd76 in term 0.
I20260811 01:42:53.008868 7245 raft_consensus.cc:2454] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44a0bd88fdb48edb6d6885f7ed5dd76 in term 0.
I20260811 01:42:53.009451 7035 leader_election.cc:302] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 101004c20d8648cd8782abb7cab38797, f44a0bd88fdb48edb6d6885f7ed5dd76; no voters:
I20260811 01:42:53.009941 7320 raft_consensus.cc:2781] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:53.010102 7320 raft_consensus.cc:482] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:53.010231 7320 raft_consensus.cc:3037] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:53.012437 7320 raft_consensus.cc:504] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:53.013036 7320 leader_election.cc:288] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [CANDIDATE]: Term 1 election: Requested vote from peers 5e859643b61d409a94ffee019573c5ee (127.17.132.3:42637), 101004c20d8648cd8782abb7cab38797 (127.17.132.1:42179)
I20260811 01:42:53.013528 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e78d34cf3ef4549a159b3b87c08f4e7" candidate_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e859643b61d409a94ffee019573c5ee"
I20260811 01:42:53.013578 6962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e78d34cf3ef4549a159b3b87c08f4e7" candidate_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "101004c20d8648cd8782abb7cab38797"
I20260811 01:42:53.013746 7245 raft_consensus.cc:3037] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:53.013852 6962 raft_consensus.cc:3037] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:53.016079 7245 raft_consensus.cc:2454] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44a0bd88fdb48edb6d6885f7ed5dd76 in term 1.
I20260811 01:42:53.016316 6962 raft_consensus.cc:2454] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44a0bd88fdb48edb6d6885f7ed5dd76 in term 1.
I20260811 01:42:53.016587 7036 leader_election.cc:302] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e859643b61d409a94ffee019573c5ee, f44a0bd88fdb48edb6d6885f7ed5dd76; no voters:
I20260811 01:42:53.016917 7320 raft_consensus.cc:2781] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:53.017421 7320 raft_consensus.cc:686] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 1 LEADER]: Becoming Leader. State: Replica: f44a0bd88fdb48edb6d6885f7ed5dd76, State: Running, Role: LEADER
I20260811 01:42:53.017973 7320 consensus_queue.cc:237] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } }
I20260811 01:42:53.023224 6808 catalog_manager.cc:5495] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44a0bd88fdb48edb6d6885f7ed5dd76 (127.17.132.2). New cstate: current_term: 1 leader_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f44a0bd88fdb48edb6d6885f7ed5dd76" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 35575 } health_report { overall_health: HEALTHY } } }
W20260811 01:42:53.041682 7295 tablet.cc:2369] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:53.070298 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.064141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.17.132.2:35575)
0811 01:42:53.064373 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.064379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.064478 (+ 99us) server_negotiation.cc:407] Connection header received
0811 01:42:53.064755 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.064759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.064843 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.065025 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:53.065428 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.066303 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.067754 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.068188 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.068341 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.068919 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:53.069496 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:53.069682 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.069891 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.069969 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:42:53.079566 7245 raft_consensus.cc:1261] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 1 FOLLOWER]: Refusing update from remote peer f44a0bd88fdb48edb6d6885f7ed5dd76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:53.079614 6962 raft_consensus.cc:1261] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 1 FOLLOWER]: Refusing update from remote peer f44a0bd88fdb48edb6d6885f7ed5dd76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:53.080730 7324 consensus_queue.cc:1035] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "101004c20d8648cd8782abb7cab38797" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:53.081115 7320 consensus_queue.cc:1035] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e859643b61d409a94ffee019573c5ee" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:53.113394 6808 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:53.113672 6808 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:53.117394 6808 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e9037016c8140ee985284332755af55: Sending DeleteTablet for 3 replicas of tablet 8e78d34cf3ef4549a159b3b87c08f4e7
I20260811 01:42:53.118652 7224 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:53 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:43390
I20260811 01:42:53.118664 6941 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:53 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:59104
I20260811 01:42:53.118716 7083 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e78d34cf3ef4549a159b3b87c08f4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:53 UTC) from {username='kudu', principal='kudu/127.17.132.62@KRBTEST.COM'} at 127.0.0.1:47054
I20260811 01:42:53.120466 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6874
I20260811 01:42:53.134694 7340 tablet_replica.cc:330] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: stopping tablet replica
I20260811 01:42:53.135416 7340 raft_consensus.cc:2229] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:53.136159 7340 raft_consensus.cc:2258] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:53.139323 7340 ts_tablet_manager.cc:1905] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:53.139983 7339 tablet_replica.cc:330] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: stopping tablet replica
I20260811 01:42:53.140462 7339 raft_consensus.cc:2229] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:53.141000 7339 raft_consensus.cc:2258] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:53.142544 7338 tablet_replica.cc:330] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: stopping tablet replica
I20260811 01:42:53.142977 7338 raft_consensus.cc:2229] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:53.143740 7338 raft_consensus.cc:2258] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:53.146026 7340 ts_tablet_manager.cc:1918] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:53.146185 7340 log.cc:1196] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/8e78d34cf3ef4549a159b3b87c08f4e7
I20260811 01:42:53.146775 7340 ts_tablet_manager.cc:1939] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 5e859643b61d409a94ffee019573c5ee: Deleting consensus metadata
Aug 11 01:42:53 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.1@KRBTEST.COM
I20260811 01:42:53.148588 7339 ts_tablet_manager.cc:1905] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:53.148669 6791 catalog_manager.cc:4841] TS 5e859643b61d409a94ffee019573c5ee (127.17.132.3:42637): tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (table test-table [id=7919dcca434e4eadb4942721d9d641ec]) successfully deleted
I20260811 01:42:53.149248 7338 ts_tablet_manager.cc:1905] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:53.154475 7339 ts_tablet_manager.cc:1918] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:53.154662 7339 log.cc:1196] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-0/wal/wals/8e78d34cf3ef4549a159b3b87c08f4e7
I20260811 01:42:53.155611 7339 ts_tablet_manager.cc:1939] T 8e78d34cf3ef4549a159b3b87c08f4e7 P 101004c20d8648cd8782abb7cab38797: Deleting consensus metadata
I20260811 01:42:53.157624 7338 ts_tablet_manager.cc:1918] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:53.157892 7338 log.cc:1196] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/8e78d34cf3ef4549a159b3b87c08f4e7
I20260811 01:42:53.157908 6790 catalog_manager.cc:4841] TS 101004c20d8648cd8782abb7cab38797 (127.17.132.1:42179): tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (table test-table [id=7919dcca434e4eadb4942721d9d641ec]) successfully deleted
I20260811 01:42:53.158535 7338 ts_tablet_manager.cc:1939] T 8e78d34cf3ef4549a159b3b87c08f4e7 P f44a0bd88fdb48edb6d6885f7ed5dd76: Deleting consensus metadata
I20260811 01:42:53.160290 6791 catalog_manager.cc:4841] TS f44a0bd88fdb48edb6d6885f7ed5dd76 (127.17.132.2:35575): tablet 8e78d34cf3ef4549a159b3b87c08f4e7 (table test-table [id=7919dcca434e4eadb4942721d9d641ec]) successfully deleted
I20260811 01:42:53.162012 7310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.122526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.17.132.1:42179)
0811 01:42:53.122761 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.122770 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.132878 (+ 10108us) server_negotiation.cc:407] Connection header received
0811 01:42:53.133353 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.133360 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.133451 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.133526 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:53.135846 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.137423 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.140490 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.141191 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.141289 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.154262 (+ 12973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:53.154277 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:53.154297 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:53.154342 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:53.158625 (+ 4283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.159572 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.159581 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.159585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.159776 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.160267 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.160275 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.160279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.160729 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:53.161040 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.161393 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.161614 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:42:53.162757 7007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:53.265911 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6874
I20260811 01:42:53.287830 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7018
Aug 11 01:42:53 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.2@KRBTEST.COM
I20260811 01:42:53.304600 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.288958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.17.132.2:35575)
0811 01:42:53.289168 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.289172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.289202 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:42:53.289263 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.289266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.289364 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.289491 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:53.290927 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.291749 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.292997 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.293423 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.293552 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.298366 (+ 4814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:53.298382 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:53.298397 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:53.298440 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:53.301550 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.302455 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.302462 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.302464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.302603 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.303019 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.303023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.303025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.303384 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:53.303779 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.304000 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.304244 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:42:53.305392 7148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:53.424083 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7018
I20260811 01:42:53.446540 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7159
Aug 11 01:42:53 dist-test-slave-0kls krb5kdc[6759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.3@KRBTEST.COM
I20260811 01:42:53.463069 7309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:53.447379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.17.132.3:42637)
0811 01:42:53.447565 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:53.447569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:53.447588 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:42:53.447696 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:53.447700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:53.447775 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:53.447866 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:53.449167 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.449992 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.451345 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:53.451758 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:53.451856 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:53.456816 (+ 4960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:53.456833 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:53.456851 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:53.456900 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:53.459972 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.460722 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.460730 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.460732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.460875 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:53.461370 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:53.461377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:53.461380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:53.461765 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:53.462141 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:53.462480 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 01:42:53.462713 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:42:53.463768 7289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:53.553974 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7159
I20260811 01:42:53.574671 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 6772
I20260811 01:42:53.575897 6843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:53.689621 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 6772
2026-08-11T01:42:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4751 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T01:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:53Z Disabled control of system clock
I20260811 01:42:53.784687 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46573
--webserver_interface=127.17.132.62
--webserver_port=0
--builtin_ntp_servers=127.17.132.20:44135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:46573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:54.133100 7349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:54.133430 7349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:54.133570 7349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:54.141086 7349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:54.141211 7349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:54.141305 7349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:54.141426 7349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:54.141498 7349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:54.151139 7349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:46573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:54.152544 7349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:54.154474 7349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:54.166571 7355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:54.166543 7357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:54.166646 7354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:54.167392 7349 server_base.cc:1034] running on GCE node
I20260811 01:42:54.168202 7349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:54.169621 7349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:54.170823 7349 hybrid_clock.cc:648] HybridClock initialized: now 1786412574170777 us; error 65 us; skew 500 ppm
I20260811 01:42:54.171207 7349 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:54.180546 7349 webserver.cc:460] Webserver started at http://127.17.132.62:34593/ using document root <none> and password file <none>
I20260811 01:42:54.181370 7349 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:54.181514 7349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:54.181963 7349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:54.185050 7349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "5caa6b4088a049a68e6949daafe9c63b"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "8ee9f930c1cbae3837f55e35cd9bb589"
server_key_iv: "c0b8af3b466fc58bf5ab255f0f851207"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.186008 7349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "5caa6b4088a049a68e6949daafe9c63b"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "8ee9f930c1cbae3837f55e35cd9bb589"
server_key_iv: "c0b8af3b466fc58bf5ab255f0f851207"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.191478 7349 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:42:54.195216 7363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:54.196785 7349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:42:54.196995 7349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "5caa6b4088a049a68e6949daafe9c63b"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "8ee9f930c1cbae3837f55e35cd9bb589"
server_key_iv: "c0b8af3b466fc58bf5ab255f0f851207"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.197221 7349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:54.231362 7349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:54.232255 7349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:54.232553 7349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:54.251577 7349 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:46573
I20260811 01:42:54.251616 7416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:46573 every 8 connection(s)
I20260811 01:42:54.252907 7349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:54.253949 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7349
I20260811 01:42:54.254139 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:54.254722 17936 external_mini_cluster.cc:1428] Setting key a4c3d31aebe184121ddf741fe7b19fa3
I20260811 01:42:54.257608 7417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:54.268751 7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:54.256794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56684 (local address 127.17.132.62:46573)
0811 01:42:54.257940 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:54.257951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:54.257994 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:42:54.259670 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:54.259690 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:54.260160 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:54.260486 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:54.261075 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.262509 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.264443 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.265075 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.265203 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:54.266477 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:54.266484 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:54.266499 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:54.267041 (+ 542us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:54.267123 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:54.267149 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:54.267240 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:54.267488 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 01:42:54.267833 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":407,"threads_started":1}
I20260811 01:42:54.270057 7417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: Bootstrap starting.
I20260811 01:42:54.273083 7417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:54.274128 7417 log.cc:824] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:54.276741 7417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: No bootstrap required, opened a new log
I20260811 01:42:54.283883 7417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } }
I20260811 01:42:54.284253 7417 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:54.284374 7417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5caa6b4088a049a68e6949daafe9c63b, State: Initialized, Role: FOLLOWER
I20260811 01:42:54.284984 7417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } }
I20260811 01:42:54.285219 7417 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:54.285354 7417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:54.285533 7417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:54.287715 7417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } }
I20260811 01:42:54.288228 7417 leader_election.cc:302] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5caa6b4088a049a68e6949daafe9c63b; no voters:
I20260811 01:42:54.288888 7417 leader_election.cc:288] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:54.289008 7422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:54.289820 7422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [term 1 LEADER]: Becoming Leader. State: Replica: 5caa6b4088a049a68e6949daafe9c63b, State: Running, Role: LEADER
I20260811 01:42:54.290350 7422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } }
I20260811 01:42:54.290984 7417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:54.293529 7423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5caa6b4088a049a68e6949daafe9c63b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } } }
I20260811 01:42:54.293560 7426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5caa6b4088a049a68e6949daafe9c63b. Latest consensus state: current_term: 1 leader_uuid: "5caa6b4088a049a68e6949daafe9c63b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5caa6b4088a049a68e6949daafe9c63b" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46573 } } }
I20260811 01:42:54.294404 7423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:54.294512 7426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:54.296787 7434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:54.302104 7434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:54.315703 7434 catalog_manager.cc:1347] Generated new cluster ID: c6ace6f1f0034cb5b842370e35e8d617
I20260811 01:42:54.315848 7434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:54.349104 7434 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:54.351114 7434 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:54.369318 7434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: Generated new TSK 0
I20260811 01:42:54.370550 7434 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:42:54.384670 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.1:0
--local_ip_for_outbound_sockets=127.17.132.1
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--builtin_ntp_servers=127.17.132.20:44135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:42:54.732378 7445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:54.732712 7445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:54.732854 7445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:54.740079 7445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:54.740180 7445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:54.740362 7445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.1
I20260811 01:42:54.749578 7445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.132.1
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.1
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:54.750988 7445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:54.752813 7445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:54.767356 7452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:54.767282 7453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:54.767331 7455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:54.770205 7445 server_base.cc:1034] running on GCE node
I20260811 01:42:54.770916 7445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:54.771916 7445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:54.773145 7445 hybrid_clock.cc:648] HybridClock initialized: now 1786412574773096 us; error 58 us; skew 500 ppm
I20260811 01:42:54.773491 7445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:54.775987 7445 webserver.cc:460] Webserver started at http://127.17.132.1:37337/ using document root <none> and password file <none>
I20260811 01:42:54.776726 7445 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:54.776877 7445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:54.777212 7445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:54.780264 7445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data/instance:
uuid: "a23085993de4408b892b3555c030693f"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "6520575af412aa3cba9684968e1b42a8"
server_key_iv: "b0d2c52a2746b326bb26aab26b2675ce"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.781119 7445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance:
uuid: "a23085993de4408b892b3555c030693f"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "6520575af412aa3cba9684968e1b42a8"
server_key_iv: "b0d2c52a2746b326bb26aab26b2675ce"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.786674 7445 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:42:54.790234 7461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:54.791684 7445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:42:54.791872 7445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal
uuid: "a23085993de4408b892b3555c030693f"
format_stamp: "Formatted at 2026-08-11 01:42:54 on dist-test-slave-0kls"
server_key: "6520575af412aa3cba9684968e1b42a8"
server_key_iv: "b0d2c52a2746b326bb26aab26b2675ce"
server_key_version: "encryptionkey@0"
I20260811 01:42:54.792115 7445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:54.808008 7445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:54.808795 7445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:54.809101 7445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:54.810101 7445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:54.811501 7445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:54.811630 7445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:54.811753 7445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:54.811841 7445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:54.845609 7445 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.1:42993
I20260811 01:42:54.845659 7581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.1:42993 every 8 connection(s)
I20260811 01:42:54.846956 7445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/data/info.pb
I20260811 01:42:54.848783 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7445
I20260811 01:42:54.848970 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-0/wal/instance
I20260811 01:42:54.849474 17936 external_mini_cluster.cc:1428] Setting key 4f0a7d70de38801690bcaebca4316882
I20260811 01:42:54.852460 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.2:0
--local_ip_for_outbound_sockets=127.17.132.2
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--builtin_ntp_servers=127.17.132.20:44135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:54.859947 7584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:54.849738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.1:57101 (local address 127.17.132.62:46573)
0811 01:42:54.850295 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:54.850302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:54.852717 (+ 2415us) server_negotiation.cc:407] Connection header received
0811 01:42:54.853537 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:54.853542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:54.853623 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:54.853759 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:54.854831 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.855561 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.857084 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.857498 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.857637 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:54.859040 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:54.859052 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:54.859056 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:54.859073 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:54.859113 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:54.859125 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:54.859221 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:54.859448 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 01:42:54.859546 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":265,"threads_started":1}
I20260811 01:42:54.860909 7585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:54.850417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46573 (local address 127.17.132.1:57101)
0811 01:42:54.851473 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:54.851526 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:54.853283 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:54.854022 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:54.854030 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:54.854113 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:54.854668 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:54.854684 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.855718 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.855725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:54.856926 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:54.856938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:54.857727 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:54.857737 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:54.858005 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:54.858710 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:54.858713 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:54.858753 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:54.858826 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:54.859224 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:54.859238 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:54.859247 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 01:42:54.859421 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 01:42:54.859834 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":290,"threads_started":1}
I20260811 01:42:54.862579 7582 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46573
I20260811 01:42:54.862933 7582 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:54.863869 7582 heartbeater.cc:511] Master 127.17.132.62:46573 requested a full tablet report, sending...
I20260811 01:42:54.866238 7382 ts_manager.cc:194] Registered new tserver with Master: a23085993de4408b892b3555c030693f (127.17.132.1:42993)
I20260811 01:42:54.867720 7382 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.1:57101
W20260811 01:42:55.200881 7586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:55.201264 7586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:55.201443 7586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:55.209142 7586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:55.209276 7586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:55.209453 7586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.2
I20260811 01:42:55.218573 7586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.132.2
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.2
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:55.219887 7586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:55.221650 7586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:55.234891 7591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:55.235088 7595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:55.235270 7592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:55.235826 7586 server_base.cc:1034] running on GCE node
I20260811 01:42:55.236397 7586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:55.237375 7586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:55.238605 7586 hybrid_clock.cc:648] HybridClock initialized: now 1786412575238566 us; error 48 us; skew 500 ppm
I20260811 01:42:55.238919 7586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:55.241132 7586 webserver.cc:460] Webserver started at http://127.17.132.2:32817/ using document root <none> and password file <none>
I20260811 01:42:55.241914 7586 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:55.242054 7586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:55.242385 7586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:55.245229 7586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data/instance:
uuid: "e36ece48aca141deb565538abf2ccd1e"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "df7bb3781d8be1b11d04ed115d8f1e53"
server_key_iv: "25712bca861bb17fb5aedeb028bbaa69"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.246127 7586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance:
uuid: "e36ece48aca141deb565538abf2ccd1e"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "df7bb3781d8be1b11d04ed115d8f1e53"
server_key_iv: "25712bca861bb17fb5aedeb028bbaa69"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.251343 7586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 01:42:55.255003 7602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.256454 7586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:42:55.256626 7586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal
uuid: "e36ece48aca141deb565538abf2ccd1e"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "df7bb3781d8be1b11d04ed115d8f1e53"
server_key_iv: "25712bca861bb17fb5aedeb028bbaa69"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.256839 7586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:55.280308 7586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:55.281149 7586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:55.281473 7586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:55.282532 7586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:55.283998 7586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:55.284152 7586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.284291 7586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:55.284389 7586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.318650 7586 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.2:45853
I20260811 01:42:55.318744 7724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.2:45853 every 8 connection(s)
I20260811 01:42:55.320063 7586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/data/info.pb
I20260811 01:42:55.327211 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7586
I20260811 01:42:55.327409 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal/instance
I20260811 01:42:55.327986 17936 external_mini_cluster.cc:1428] Setting key f551995237a1cb9b372ec73b77a53479
I20260811 01:42:55.331475 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.132.3:0
--local_ip_for_outbound_sockets=127.17.132.3
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--builtin_ntp_servers=127.17.132.20:44135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:42:55.334467 7584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.322677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.2:53177 (local address 127.17.132.62:46573)
0811 01:42:55.322901 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.322907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.324353 (+ 1446us) server_negotiation.cc:407] Connection header received
0811 01:42:55.326268 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.326272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.326341 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.326432 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:55.327675 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.328708 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.331172 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.331773 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.331902 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.333621 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:55.333627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:55.333631 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:55.333651 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:55.333690 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:55.333706 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:55.333858 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.334095 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.334188 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:42:55.335923 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.323230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46573 (local address 127.17.132.2:53177)
0811 01:42:55.324195 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.324233 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.326013 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.326644 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.326652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.326743 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:55.327460 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.327500 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.329153 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.329158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.330985 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.331002 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.332014 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.332024 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.332394 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.333218 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:55.333224 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:55.333282 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:55.333399 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:55.333840 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:55.333854 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:55.333865 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:42:55.334055 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 01:42:55.334496 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":307,"threads_started":1}
I20260811 01:42:55.337523 7725 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46573
I20260811 01:42:55.337898 7725 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:55.338867 7725 heartbeater.cc:511] Master 127.17.132.62:46573 requested a full tablet report, sending...
I20260811 01:42:55.340735 7382 ts_manager.cc:194] Registered new tserver with Master: e36ece48aca141deb565538abf2ccd1e (127.17.132.2:45853)
I20260811 01:42:55.342077 7382 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.2:53177
W20260811 01:42:55.680812 7728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:55.681119 7728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:55.681210 7728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:55.688614 7728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:55.688724 7728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:55.688833 7728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.132.3
I20260811 01:42:55.698514 7728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.132.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.132.3
--webserver_port=0
--tserver_master_addrs=127.17.132.62:46573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.132.3
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:55.699790 7728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:55.701599 7728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:55.714790 7734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:55.714888 7735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:55.715224 7737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:55.716051 7728 server_base.cc:1034] running on GCE node
I20260811 01:42:55.716737 7728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:55.717664 7728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:55.718900 7728 hybrid_clock.cc:648] HybridClock initialized: now 1786412575718839 us; error 65 us; skew 500 ppm
I20260811 01:42:55.719256 7728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:42:55.721621 7728 webserver.cc:460] Webserver started at http://127.17.132.3:46581/ using document root <none> and password file <none>
I20260811 01:42:55.722400 7728 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:55.722541 7728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:55.722905 7728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:55.726050 7728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data/instance:
uuid: "d04fd48eaab2491bac1d531ff451b083"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "62144c34711a09009582b2d0e5e52bf8"
server_key_iv: "4b4ab8cf06fc27376743b974b50c248f"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.726989 7728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance:
uuid: "d04fd48eaab2491bac1d531ff451b083"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "62144c34711a09009582b2d0e5e52bf8"
server_key_iv: "4b4ab8cf06fc27376743b974b50c248f"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.732590 7728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:42:55.736372 7745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.737918 7728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:42:55.738116 7728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal
uuid: "d04fd48eaab2491bac1d531ff451b083"
format_stamp: "Formatted at 2026-08-11 01:42:55 on dist-test-slave-0kls"
server_key: "62144c34711a09009582b2d0e5e52bf8"
server_key_iv: "4b4ab8cf06fc27376743b974b50c248f"
server_key_version: "encryptionkey@0"
I20260811 01:42:55.738346 7728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:55.753141 7728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:55.754129 7728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:55.754447 7728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:55.755501 7728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:42:55.757064 7728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:42:55.757189 7728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.757356 7728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:42:55.757449 7728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:55.791740 7728 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.3:34205
I20260811 01:42:55.791795 7862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.3:34205 every 8 connection(s)
I20260811 01:42:55.793143 7728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/data/info.pb
I20260811 01:42:55.795734 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7728
I20260811 01:42:55.795931 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal/instance
I20260811 01:42:55.796506 17936 external_mini_cluster.cc:1428] Setting key 483e661e5b30232abfa898facfcf01d2
I20260811 01:42:55.806425 7584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.795977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:42051 (local address 127.17.132.62:46573)
0811 01:42:55.796204 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.796210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.798074 (+ 1864us) server_negotiation.cc:407] Connection header received
0811 01:42:55.799923 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.799928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.800021 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.800134 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:55.801259 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.802067 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.803618 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.804039 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.804204 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.805470 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:55.805474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:55.805477 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:55.805494 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:55.805538 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:55.805551 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:55.805649 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.805933 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.806071 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 01:42:55.807420 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.796691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:46573 (local address 127.17.132.3:42051)
0811 01:42:55.797888 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.797942 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.799651 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.800375 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.800383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.800466 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:42:55.801085 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.801103 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.802226 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.802230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.803456 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.803468 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.804305 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.804312 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.804540 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.805167 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:42:55.805169 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:42:55.805206 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:42:55.805278 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:42:55.805649 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:42:55.805663 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:42:55.805673 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:42:55.805923 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 01:42:55.806351 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":412,"threads_started":1}
I20260811 01:42:55.808804 7863 heartbeater.cc:347] Connected to a master server at 127.17.132.62:46573
I20260811 01:42:55.809096 7863 heartbeater.cc:464] Registering TS with master...
I20260811 01:42:55.809950 7863 heartbeater.cc:511] Master 127.17.132.62:46573 requested a full tablet report, sending...
I20260811 01:42:55.811573 7381 ts_manager.cc:194] Registered new tserver with Master: d04fd48eaab2491bac1d531ff451b083 (127.17.132.3:34205)
I20260811 01:42:55.812419 7381 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.132.3:42051
I20260811 01:42:55.823925 17936 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:42:55.834007 7584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.828315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.17.132.62:46573)
0811 01:42:55.828493 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.828497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.828921 (+ 424us) server_negotiation.cc:407] Connection header received
0811 01:42:55.829056 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.829060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.829118 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.829228 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:55.829669 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.830559 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.831908 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.832340 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.832435 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.833393 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:55.833397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:55.833400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:55.833417 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:55.833447 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:55.833459 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:55.833527 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.833658 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.833728 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:42:55.837965 7381 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56696:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:42:55.845100 7381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:42:55.871510 7582 heartbeater.cc:503] Master 127.17.132.62:46573 was elected leader, sending a full tablet report...
I20260811 01:42:55.884315 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.858263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60058 (local address 127.17.132.3:34205)
0811 01:42:55.872698 (+ 14435us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.872708 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.873710 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 01:42:55.874151 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.874164 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.874526 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.874748 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:55.876061 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.878248 (+ 2187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.881550 (+ 3302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.882860 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.882993 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.883297 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.883784 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.883972 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14166,"thread_start_us":14460,"threads_started":1}
I20260811 01:42:55.884394 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.857826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.3:34205 (local address 127.0.0.1:60058)
0811 01:42:55.873544 (+ 15718us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.873571 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.873883 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.875239 (+ 1356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.875251 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.875304 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:55.875767 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.875783 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.878494 (+ 2711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.878503 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.881324 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.881343 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.883206 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.883212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.883509 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.883571 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 01:42:55.883719 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 01:42:55.883922 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15531,"mutex_wait_us":1,"thread_start_us":998,"threads_started":1}
I20260811 01:42:55.886787 7878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.857613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:45853 (local address 127.0.0.1:47764)
0811 01:42:55.859212 (+ 1599us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.859258 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.859418 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.879858 (+ 20440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.879864 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.879895 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:55.880416 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.880430 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.882326 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.882332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.884495 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.884516 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.886082 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.886088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.886236 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.886265 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 01:42:55.886358 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 01:42:55.886485 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1345,"thread_start_us":15562,"threads_started":1}
I20260811 01:42:55.887606 7879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.857882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.17.132.2:45853)
0811 01:42:55.879142 (+ 21260us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.879152 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.879188 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:42:55.879298 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.879305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.879609 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.879868 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:55.880627 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.882171 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.884721 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.885884 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.886017 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.886244 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.886419 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.886587 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21094,"thread_start_us":20986,"threads_started":1}
I20260811 01:42:55.888038 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.859551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50118)
0811 01:42:55.879514 (+ 19963us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.879534 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.880277 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.880975 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.880979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.881010 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:55.881418 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.881428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.883008 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.883016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.885332 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.885346 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.887337 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.887343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:55.887499 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.887535 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:42:55.887635 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:42:55.887744 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19842,"thread_start_us":19670,"threads_started":1}
I20260811 01:42:55.888825 7882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.860085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.17.132.1:42993)
0811 01:42:55.878475 (+ 18390us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.878488 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.879690 (+ 1202us) server_negotiation.cc:407] Connection header received
0811 01:42:55.880511 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.880519 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.880758 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.880941 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:55.881635 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.882857 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.885528 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:55.887134 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:55.887298 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:55.887552 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:55.888308 (+ 756us) server_negotiation.cc:299] Negotiation successful
0811 01:42:55.888471 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18125,"thread_start_us":18403,"threads_started":1}
I20260811 01:42:55.888944 7794 tablet_service.cc:1467] Processing CreateTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f (DEFAULT_TABLE table=test-table [id=929822c1ee88490f96c06347b3b763e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:55.890563 7794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015b6d1dc24c4cccb340fd97a0002a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:55.891218 7655 tablet_service.cc:1467] Processing CreateTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f (DEFAULT_TABLE table=test-table [id=929822c1ee88490f96c06347b3b763e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:55.892458 7655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015b6d1dc24c4cccb340fd97a0002a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:55.892537 7514 tablet_service.cc:1467] Processing CreateTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f (DEFAULT_TABLE table=test-table [id=929822c1ee88490f96c06347b3b763e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:42:55.894054 7514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015b6d1dc24c4cccb340fd97a0002a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:55.905247 7883 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Bootstrap starting.
I20260811 01:42:55.909621 7883 tablet_bootstrap.cc:654] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:55.910737 7883 log.cc:824] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:55.912096 7885 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Bootstrap starting.
I20260811 01:42:55.914366 7886 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Bootstrap starting.
I20260811 01:42:55.917081 7885 tablet_bootstrap.cc:654] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:55.918560 7885 log.cc:824] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:55.918712 7886 tablet_bootstrap.cc:654] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:55.920085 7886 log.cc:824] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:55.920603 7883 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: No bootstrap required, opened a new log
I20260811 01:42:55.921077 7883 ts_tablet_manager.cc:1397] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260811 01:42:55.922303 7885 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: No bootstrap required, opened a new log
I20260811 01:42:55.922600 7885 ts_tablet_manager.cc:1397] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:42:55.928488 7886 tablet_bootstrap.cc:492] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: No bootstrap required, opened a new log
I20260811 01:42:55.928823 7886 ts_tablet_manager.cc:1397] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260811 01:42:55.930677 7885 raft_consensus.cc:348] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.931099 7885 raft_consensus.cc:374] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:55.931239 7885 raft_consensus.cc:729] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04fd48eaab2491bac1d531ff451b083, State: Initialized, Role: FOLLOWER
I20260811 01:42:55.931914 7885 consensus_queue.cc:260] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.933143 7863 heartbeater.cc:503] Master 127.17.132.62:46573 was elected leader, sending a full tablet report...
I20260811 01:42:55.933109 7883 raft_consensus.cc:348] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.933599 7883 raft_consensus.cc:374] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:55.933717 7883 raft_consensus.cc:729] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36ece48aca141deb565538abf2ccd1e, State: Initialized, Role: FOLLOWER
I20260811 01:42:55.933866 7885 ts_tablet_manager.cc:1428] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260811 01:42:55.934420 7883 consensus_queue.cc:260] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.935631 7725 heartbeater.cc:503] Master 127.17.132.62:46573 was elected leader, sending a full tablet report...
I20260811 01:42:55.938081 7883 ts_tablet_manager.cc:1428] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260811 01:42:55.941433 7886 raft_consensus.cc:348] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.941929 7886 raft_consensus.cc:374] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:55.942045 7886 raft_consensus.cc:729] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23085993de4408b892b3555c030693f, State: Initialized, Role: FOLLOWER
I20260811 01:42:55.942677 7886 consensus_queue.cc:260] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.944489 7886 ts_tablet_manager.cc:1428] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260811 01:42:55.995493 7890 raft_consensus.cc:482] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:42:55.995869 7890 raft_consensus.cc:504] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:55.997865 7890 leader_election.cc:288] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36ece48aca141deb565538abf2ccd1e (127.17.132.2:45853), a23085993de4408b892b3555c030693f (127.17.132.1:42993)
I20260811 01:42:56.005365 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.998314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.2:45853 (local address 127.17.132.3:33015)
0811 01:42:55.998558 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.998580 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.998731 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.999270 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.999276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.999311 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:55.999502 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:55.999513 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.000819 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.000848 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:56.003272 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:56.003291 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.004516 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.004522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:56.004699 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.004725 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:42:56.004846 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 01:42:56.004998 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":4}
I20260811 01:42:56.005693 7879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.998253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:33015 (local address 127.17.132.2:45853)
0811 01:42:55.998591 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.998598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.998647 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:42:55.998945 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.998953 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.999089 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.999197 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:55.999679 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.000697 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.003495 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.004348 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.004534 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.004611 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.004902 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.005089 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260811 01:42:56.006613 7882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.998522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.132.3:38057 (local address 127.17.132.1:42993)
0811 01:42:55.998735 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:55.998740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:55.999494 (+ 754us) server_negotiation.cc:407] Connection header received
0811 01:42:55.999625 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:55.999631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:55.999722 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:55.999803 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:42:56.000446 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.001452 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.003741 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.005573 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.005764 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.005888 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.006210 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.006342 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:42:56.006661 7893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:55.998366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.17.132.3:38057)
0811 01:42:55.999388 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:55.999402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:42:55.999504 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:42:55.999846 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:42:55.999850 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:42:55.999875 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:42:56.000233 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:56.000245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.001680 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.001687 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:56.003463 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:42:56.003479 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.005741 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.005750 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:42:56.005965 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.005998 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:42:56.006176 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 01:42:56.006307 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":883,"mutex_wait_us":294,"thread_start_us":463,"threads_started":1}
I20260811 01:42:56.007854 7675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015b6d1dc24c4cccb340fd97a0002a4f" candidate_uuid: "d04fd48eaab2491bac1d531ff451b083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ece48aca141deb565538abf2ccd1e" is_pre_election: true
I20260811 01:42:56.007994 7535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015b6d1dc24c4cccb340fd97a0002a4f" candidate_uuid: "d04fd48eaab2491bac1d531ff451b083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23085993de4408b892b3555c030693f" is_pre_election: true
I20260811 01:42:56.008522 7535 raft_consensus.cc:2454] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04fd48eaab2491bac1d531ff451b083 in term 0.
I20260811 01:42:56.008538 7675 raft_consensus.cc:2454] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04fd48eaab2491bac1d531ff451b083 in term 0.
I20260811 01:42:56.009419 7749 leader_election.cc:302] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23085993de4408b892b3555c030693f, d04fd48eaab2491bac1d531ff451b083; no voters:
I20260811 01:42:56.010205 7890 raft_consensus.cc:2781] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:42:56.010365 7890 raft_consensus.cc:482] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:42:56.010478 7890 raft_consensus.cc:3037] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:56.013171 7890 raft_consensus.cc:504] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:56.013846 7890 leader_election.cc:288] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [CANDIDATE]: Term 1 election: Requested vote from peers e36ece48aca141deb565538abf2ccd1e (127.17.132.2:45853), a23085993de4408b892b3555c030693f (127.17.132.1:42993)
I20260811 01:42:56.014356 7535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015b6d1dc24c4cccb340fd97a0002a4f" candidate_uuid: "d04fd48eaab2491bac1d531ff451b083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23085993de4408b892b3555c030693f"
I20260811 01:42:56.014585 7535 raft_consensus.cc:3037] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:56.016877 7535 raft_consensus.cc:2454] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04fd48eaab2491bac1d531ff451b083 in term 1.
I20260811 01:42:56.017325 7749 leader_election.cc:302] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23085993de4408b892b3555c030693f, d04fd48eaab2491bac1d531ff451b083; no voters:
I20260811 01:42:56.017238 7675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015b6d1dc24c4cccb340fd97a0002a4f" candidate_uuid: "d04fd48eaab2491bac1d531ff451b083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ece48aca141deb565538abf2ccd1e"
I20260811 01:42:56.017542 7675 raft_consensus.cc:3037] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:56.017648 7890 raft_consensus.cc:2781] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:56.018182 7890 raft_consensus.cc:686] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 1 LEADER]: Becoming Leader. State: Replica: d04fd48eaab2491bac1d531ff451b083, State: Running, Role: LEADER
I20260811 01:42:56.018781 7890 consensus_queue.cc:237] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } }
I20260811 01:42:56.020272 7675 raft_consensus.cc:2454] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04fd48eaab2491bac1d531ff451b083 in term 1.
I20260811 01:42:56.023619 7380 catalog_manager.cc:5495] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 reported cstate change: term changed from 0 to 1, leader changed from <none> to d04fd48eaab2491bac1d531ff451b083 (127.17.132.3). New cstate: current_term: 1 leader_uuid: "d04fd48eaab2491bac1d531ff451b083" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04fd48eaab2491bac1d531ff451b083" member_type: VOTER last_known_addr { host: "127.17.132.3" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 } health_report { overall_health: UNKNOWN } } }
W20260811 01:42:56.045096 7864 tablet.cc:2369] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:56.061355 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.055755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60066 (local address 127.17.132.3:34205)
0811 01:42:56.055959 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:56.055964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:56.056084 (+ 120us) server_negotiation.cc:407] Connection header received
0811 01:42:56.056277 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:56.056281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:56.056359 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:56.056487 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:42:56.056887 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.057680 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.059261 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.059674 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.059786 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.060278 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:42:56.060878 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:42:56.061040 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.061080 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.061148 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:42:56.070061 7675 raft_consensus.cc:1261] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 1 FOLLOWER]: Refusing update from remote peer d04fd48eaab2491bac1d531ff451b083: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:56.070109 7535 raft_consensus.cc:1261] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 1 FOLLOWER]: Refusing update from remote peer d04fd48eaab2491bac1d531ff451b083: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:42:56.071090 7894 consensus_queue.cc:1035] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ece48aca141deb565538abf2ccd1e" member_type: VOTER last_known_addr { host: "127.17.132.2" port: 45853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:42:56.071494 7890 consensus_queue.cc:1035] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23085993de4408b892b3555c030693f" member_type: VOTER last_known_addr { host: "127.17.132.1" port: 42993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:42:56.072238 7726 tablet.cc:2369] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:42:56.084519 7898 mvcc.cc:205] Tried to move back new op lower bound from 7317145911572148224 to 7317145911377285120. Current Snapshot: MvccSnapshot[applied={T|T < 7317145911572148224}]
I20260811 01:42:56.084645 7897 mvcc.cc:205] Tried to move back new op lower bound from 7317145911572148224 to 7317145911377285120. Current Snapshot: MvccSnapshot[applied={T|T < 7317145911572148224}]
I20260811 01:42:56.099121 7380 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:56.099442 7380 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:42:56.103438 7380 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5caa6b4088a049a68e6949daafe9c63b: Sending DeleteTablet for 3 replicas of tablet 015b6d1dc24c4cccb340fd97a0002a4f
I20260811 01:42:56.104583 7655 tablet_service.cc:1514] Processing DeleteTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:56 UTC) from {username='slave'} at 127.0.0.1:47764
I20260811 01:42:56.104936 7514 tablet_service.cc:1514] Processing DeleteTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:56 UTC) from {username='slave'} at 127.0.0.1:50118
I20260811 01:42:56.105321 7794 tablet_service.cc:1514] Processing DeleteTablet for tablet 015b6d1dc24c4cccb340fd97a0002a4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:42:56 UTC) from {username='slave'} at 127.0.0.1:60058
I20260811 01:42:56.106069 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7445
I20260811 01:42:56.125885 7906 tablet_replica.cc:330] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: stopping tablet replica
I20260811 01:42:56.126613 7909 tablet_replica.cc:330] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: stopping tablet replica
I20260811 01:42:56.127075 7909 raft_consensus.cc:2229] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:42:56.127719 7909 raft_consensus.cc:2258] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:56.128830 7906 raft_consensus.cc:2229] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:56.129488 7906 raft_consensus.cc:2258] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:56.130450 7882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.107488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50126 (local address 127.17.132.1:42993)
0811 01:42:56.107694 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:56.107701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:56.117811 (+ 10110us) server_negotiation.cc:407] Connection header received
0811 01:42:56.118337 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:56.118346 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:56.118513 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:56.118603 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:56.119427 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.120905 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.123272 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.124133 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.124261 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.128522 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:56.128538 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:56.128556 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:56.129399 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:56.129473 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:56.129504 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:56.129647 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.129928 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.130067 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:42:56.131811 7577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:56.132647 7909 ts_tablet_manager.cc:1905] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:56.134938 7906 ts_tablet_manager.cc:1905] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:56.144671 7909 ts_tablet_manager.cc:1918] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:56.144945 7909 log.cc:1196] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-2/wal/wals/015b6d1dc24c4cccb340fd97a0002a4f
I20260811 01:42:56.145632 7909 ts_tablet_manager.cc:1939] T 015b6d1dc24c4cccb340fd97a0002a4f P d04fd48eaab2491bac1d531ff451b083: Deleting consensus metadata
I20260811 01:42:56.148023 7367 catalog_manager.cc:4841] TS d04fd48eaab2491bac1d531ff451b083 (127.17.132.3:34205): tablet 015b6d1dc24c4cccb340fd97a0002a4f (table test-table [id=929822c1ee88490f96c06347b3b763e6]) successfully deleted
I20260811 01:42:56.148381 7906 ts_tablet_manager.cc:1918] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:42:56.148630 7906 log.cc:1196] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Deleting WAL directory at /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786412236095684-17936-0/minicluster-data/ts-1/wal/wals/015b6d1dc24c4cccb340fd97a0002a4f
I20260811 01:42:56.149215 7906 ts_tablet_manager.cc:1939] T 015b6d1dc24c4cccb340fd97a0002a4f P e36ece48aca141deb565538abf2ccd1e: Deleting consensus metadata
I20260811 01:42:56.151257 7364 catalog_manager.cc:4841] TS e36ece48aca141deb565538abf2ccd1e (127.17.132.2:45853): tablet 015b6d1dc24c4cccb340fd97a0002a4f (table test-table [id=929822c1ee88490f96c06347b3b763e6]) successfully deleted
I20260811 01:42:56.230849 7908 tablet_replica.cc:330] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: stopping tablet replica
I20260811 01:42:56.231320 7908 raft_consensus.cc:2229] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:42:56.231871 7908 raft_consensus.cc:2258] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:42:56.233942 7908 ts_tablet_manager.cc:1905] T 015b6d1dc24c4cccb340fd97a0002a4f P a23085993de4408b892b3555c030693f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:42:56.234226 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7445
I20260811 01:42:56.255749 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7586
W20260811 01:42:56.256165 7367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.132.1:42993 (error 108)
I20260811 01:42:56.258791 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.258176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50130)
0811 01:42:56.258460 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.258590 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260811 01:42:56.259253 7367 catalog_manager.cc:4584] TS a23085993de4408b892b3555c030693f (127.17.132.1:42993): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 015b6d1dc24c4cccb340fd97a0002a4f: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
I20260811 01:42:56.264819 7879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.257512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47776 (local address 127.17.132.2:45853)
0811 01:42:56.257717 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:56.257726 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:56.257748 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:42:56.257842 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:56.257847 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:56.257979 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:56.258088 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:56.258761 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.259884 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.261368 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.262122 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.262264 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.263381 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:56.263390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:56.263404 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:56.263998 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:56.264047 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:56.264065 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:56.264192 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.264349 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.264460 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:42:56.265548 7719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:56.313254 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.312663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50146)
0811 01:42:56.312917 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.313052 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 01:42:56.314564 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.314121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50162)
0811 01:42:56.314303 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.314396 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 01:42:56.356856 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7586
I20260811 01:42:56.375046 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.374561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50174)
0811 01:42:56.374795 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.374877 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:42:56.376106 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.375759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50186)
0811 01:42:56.375918 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.375999 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 01:42:56.384729 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7728
I20260811 01:42:56.392830 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.385508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60080 (local address 127.17.132.3:34205)
0811 01:42:56.385682 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:56.385686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:56.385757 (+ 71us) server_negotiation.cc:407] Connection header received
0811 01:42:56.385988 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:56.385991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:56.386084 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:56.386167 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:56.386633 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.387445 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.389305 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:56.389750 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:56.389981 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:56.391245 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:56.391254 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:56.391272 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:42:56.391962 (+ 690us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:56.392009 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:42:56.392029 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:56.392186 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:56.392365 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 01:42:56.392477 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:42:56.393566 7858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:56.457150 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.456540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50190)
0811 01:42:56.456814 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.456924 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 01:42:56.458492 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.458028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50204)
0811 01:42:56.458253 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.458376 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260811 01:42:56.515650 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7728
I20260811 01:42:56.538642 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7349
I20260811 01:42:56.539836 7412 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:56.651346 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:56.650493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.1:42993 (local address 127.0.0.1:50212)
0811 01:42:56.650976 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 01:42:56.651104 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.1:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260811 01:42:56.651371 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7349
2026-08-11T01:42:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2961 ms)
[----------] 6 tests from EncryptionPolicyTest (23389 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:42:56 dist-test-slave-0kls krb5kdc[7918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:42:56 dist-test-slave-0kls krb5kdc[7918](info): set up 2 sockets
Aug 11 01:42:56 dist-test-slave-0kls krb5kdc[7918](info): commencing operation
krb5kdc: starting...
W20260811 01:42:57.838896 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:42:58 dist-test-slave-0kls krb5kdc[7918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:42:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:42:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:42:58.197831 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:42:58.555234 7932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:42:58.555652 7932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:42:58.555837 7932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:42:58.563489 7932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:42:58.563658 7932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:42:58.563779 7932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:42:58.563901 7932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:42:58.563982 7932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:42:58.574390 7932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39589
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:42:58.575843 7932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:42:58.577200 7932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:42:58.590157 7937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:58.590224 7941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:42:58.590204 7938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:42:58.592046 7932 server_base.cc:1034] running on GCE node
I20260811 01:42:58.593194 7932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:42:58.595036 7932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:42:58.596338 7932 hybrid_clock.cc:648] HybridClock initialized: now 1786412578596265 us; error 50 us; skew 500 ppm
I20260811 01:42:58.596808 7932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:42:58 dist-test-slave-0kls krb5kdc[7918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412578, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:42:58.600497 7932 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:42:58.602298 7932 webserver.cc:460] Webserver started at http://127.0.0.1:37421/ using document root <none> and password file <none>
I20260811 01:42:58.603053 7932 fs_manager.cc:359] Metadata directory not provided
I20260811 01:42:58.603220 7932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:42:58.603569 7932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:42:58.606940 7932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "6b81ccd532034348b7d5189a142d7361"
format_stamp: "Formatted at 2026-08-11 01:42:58 on dist-test-slave-0kls"
server_key: "457526b10fc4b02ea49a27f70904ce87"
server_key_iv: "976525c83e38cecd54f16f013ca530d2"
server_key_version: "encryptionkey@0"
I20260811 01:42:58.607841 7932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "6b81ccd532034348b7d5189a142d7361"
format_stamp: "Formatted at 2026-08-11 01:42:58 on dist-test-slave-0kls"
server_key: "457526b10fc4b02ea49a27f70904ce87"
server_key_iv: "976525c83e38cecd54f16f013ca530d2"
server_key_version: "encryptionkey@0"
I20260811 01:42:58.613745 7932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:42:58.617522 7948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:42:58.619215 7932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:42:58.619475 7932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "6b81ccd532034348b7d5189a142d7361"
format_stamp: "Formatted at 2026-08-11 01:42:58 on dist-test-slave-0kls"
server_key: "457526b10fc4b02ea49a27f70904ce87"
server_key_iv: "976525c83e38cecd54f16f013ca530d2"
server_key_version: "encryptionkey@0"
I20260811 01:42:58.619743 7932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:42:58.646512 7932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:42:58.651191 7932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:42:58.651530 7932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:42:58.672544 7932 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39589
I20260811 01:42:58.672590 8002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39589 every 8 connection(s)
I20260811 01:42:58.674116 7932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:42:58.678121 8003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:42:58.684111 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 7932
I20260811 01:42:58.684360 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:42:58.685165 17936 external_mini_cluster.cc:1428] Setting key 6f5f0c9b25ee9a048eb00ddd232ee4ad
I20260811 01:42:58.690711 8003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361: Bootstrap starting.
I20260811 01:42:58.694770 8003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361: Neither blocks nor log segments found. Creating new log.
I20260811 01:42:58.696081 8003 log.cc:824] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361: Log is configured to *not* fsync() on all Append() calls
I20260811 01:42:58.699921 8003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361: No bootstrap required, opened a new log
Aug 11 01:42:58 dist-test-slave-0kls krb5kdc[7918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:42:58.708482 8003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } }
I20260811 01:42:58.708909 8003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:42:58.709040 8003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b81ccd532034348b7d5189a142d7361, State: Initialized, Role: FOLLOWER
I20260811 01:42:58.709851 8003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } }
I20260811 01:42:58.710139 8003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:42:58.710314 8003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:42:58.710522 8003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:42:58.711117 8006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:58.687437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38487 (local address 127.0.0.1:39589)
0811 01:42:58.688372 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:58.688383 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:58.688461 (+ 78us) server_negotiation.cc:407] Connection header received
0811 01:42:58.690302 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:58.690332 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:58.690750 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:58.691177 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:58.693136 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:58.694548 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:58.696381 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:58.697523 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:58.697698 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:58.702936 (+ 5238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:58.702948 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:58.702964 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:58.703005 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:58.706417 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:58.707257 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:58.707264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:58.707271 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:58.707456 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:58.707953 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:58.707957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:58.707960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:58.708517 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:58.708858 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:58.709488 (+ 630us) server_negotiation.cc:299] Negotiation successful
0811 01:42:58.709852 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":443,"threads_started":1}
I20260811 01:42:58.713439 8003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } }
I20260811 01:42:58.714059 8003 leader_election.cc:302] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b81ccd532034348b7d5189a142d7361; no voters:
I20260811 01:42:58.714794 8003 leader_election.cc:288] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:42:58.714937 8008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:42:58.715843 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:42:58.716962 8003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:42:58.722143 8008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [term 1 LEADER]: Becoming Leader. State: Replica: 6b81ccd532034348b7d5189a142d7361, State: Running, Role: LEADER
I20260811 01:42:58.722903 8008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } }
I20260811 01:42:58.726337 8010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b81ccd532034348b7d5189a142d7361. Latest consensus state: current_term: 1 leader_uuid: "6b81ccd532034348b7d5189a142d7361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } } }
I20260811 01:42:58.726806 8010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:58.727454 8009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b81ccd532034348b7d5189a142d7361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b81ccd532034348b7d5189a142d7361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39589 } } }
I20260811 01:42:58.727830 8009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361 [sys.catalog]: This master's current role is: LEADER
I20260811 01:42:58.727995 8022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:42:58.742617 8022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:42:58.744962 8006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:42:58.723333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33145 (local address 127.0.0.1:39589)
0811 01:42:58.723565 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:42:58.723573 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:42:58.724353 (+ 780us) server_negotiation.cc:407] Connection header received
0811 01:42:58.724634 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:42:58.724644 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:42:58.724779 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:42:58.724878 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:42:58.727477 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:58.728710 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:58.730619 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:42:58.731490 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:42:58.731615 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:42:58.736367 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:42:58.736378 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:42:58.736386 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:42:58.736444 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:42:58.740196 (+ 3752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:58.741338 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:58.741344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:58.741347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:58.741510 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:42:58.742238 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:42:58.742243 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:42:58.742247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:42:58.742710 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:42:58.743002 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 01:42:58.744361 (+ 1359us) server_negotiation.cc:299] Negotiation successful
0811 01:42:58.744560 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:42:58.759495 8022 catalog_manager.cc:1347] Generated new cluster ID: 783ee9c1c2ae4549b9b14cefe717927a
I20260811 01:42:58.759654 8022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:42:58.777189 8022 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:42:58.778668 8022 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:42:58.785719 8022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b81ccd532034348b7d5189a142d7361: Generated new TSK 0
I20260811 01:42:58.786691 8022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:42:58.799479 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 7932
I20260811 01:42:58.801353 7997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:42:58.894936 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 7932
W20260811 01:42:58.916838 7916 connection.cc:535] client connection to 127.0.0.1:39589 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39589): Connection reset by peer (error 104)
2026-08-11T01:42:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2240 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:42:59 dist-test-slave-0kls krb5kdc[8036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:42:59 dist-test-slave-0kls krb5kdc[8036](info): set up 2 sockets
Aug 11 01:42:59 dist-test-slave-0kls krb5kdc[8036](info): commencing operation
krb5kdc: starting...
W20260811 01:43:00.106725 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:00 dist-test-slave-0kls krb5kdc[8036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:00.449447 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34527
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:00.805879 8050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:00.806227 8050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:00.806408 8050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:00.813796 8050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:00.813987 8050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:00.814102 8050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:00.814218 8050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:00.814287 8050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:00.824714 8050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34527
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:00.826262 8050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:00.827698 8050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:00.840533 8055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:00.840432 8056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:00.840467 8059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:00.841696 8050 server_base.cc:1034] running on GCE node
I20260811 01:43:00.842598 8050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:00.844007 8050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:00.845237 8050 hybrid_clock.cc:648] HybridClock initialized: now 1786412580845159 us; error 53 us; skew 500 ppm
I20260811 01:43:00.845620 8050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:00 dist-test-slave-0kls krb5kdc[8036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412580, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:00.852742 8050 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:00.854355 8050 webserver.cc:460] Webserver started at http://127.0.0.1:36291/ using document root <none> and password file <none>
I20260811 01:43:00.855091 8050 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:00.855244 8050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:00.855571 8050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:00.858865 8050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "965604ce123d462b89e59995ba1332b5"
format_stamp: "Formatted at 2026-08-11 01:43:00 on dist-test-slave-0kls"
server_key: "18a5b8ee872bf2d8e55cb0281ef13b0a"
server_key_iv: "1b215cf492aa9188aa215d4b84bfb4a3"
server_key_version: "encryptionkey@0"
I20260811 01:43:00.859696 8050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "965604ce123d462b89e59995ba1332b5"
format_stamp: "Formatted at 2026-08-11 01:43:00 on dist-test-slave-0kls"
server_key: "18a5b8ee872bf2d8e55cb0281ef13b0a"
server_key_iv: "1b215cf492aa9188aa215d4b84bfb4a3"
server_key_version: "encryptionkey@0"
I20260811 01:43:00.865180 8050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 01:43:00.868878 8066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:00.870288 8050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:00.870478 8050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "965604ce123d462b89e59995ba1332b5"
format_stamp: "Formatted at 2026-08-11 01:43:00 on dist-test-slave-0kls"
server_key: "18a5b8ee872bf2d8e55cb0281ef13b0a"
server_key_iv: "1b215cf492aa9188aa215d4b84bfb4a3"
server_key_version: "encryptionkey@0"
I20260811 01:43:00.870678 8050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:00.910742 8050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:00.915419 8050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:00.915769 8050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:00.935825 8050 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34527
I20260811 01:43:00.935874 8121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34527 every 8 connection(s)
I20260811 01:43:00.937338 8050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:00.941543 8122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:00.944238 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8050
I20260811 01:43:00.944465 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:00.944950 17936 external_mini_cluster.cc:1428] Setting key 328f92c4ad01d8f2cf769a0234db1120
I20260811 01:43:00.954974 8122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5: Bootstrap starting.
I20260811 01:43:00.958976 8122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:00.960465 8122 log.cc:824] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:00.960903 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:00.947067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50447 (local address 127.0.0.1:34527)
0811 01:43:00.947910 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:00.947926 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:00.947975 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:43:00.950445 (+ 2470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:00.950479 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:00.951005 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:00.951448 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:00.951972 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:00.954020 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:00.955447 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:00.956460 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:00.956684 (+ 224us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:00.957918 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:00.957932 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:00.957953 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:00.958670 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:00.958782 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:00.958819 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:00.959001 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:00.959302 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 01:43:00.959514 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":385,"threads_started":1}
I20260811 01:43:00.963683 8122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5: No bootstrap required, opened a new log
I20260811 01:43:00.965349 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:00.974237 8122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } }
I20260811 01:43:00.974699 8122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:00.974826 8122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965604ce123d462b89e59995ba1332b5, State: Initialized, Role: FOLLOWER
I20260811 01:43:00.975642 8122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } }
I20260811 01:43:00.975925 8122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:00.976115 8122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:00.976321 8122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:00.977708 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:00.970761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45733 (local address 127.0.0.1:34527)
0811 01:43:00.971002 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:00.971009 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:00.971405 (+ 396us) server_negotiation.cc:407] Connection header received
0811 01:43:00.971584 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:00.971588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:00.971652 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:00.971739 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:00.972344 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:00.973163 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:00.974945 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:00.975483 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:00.975624 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:00.976908 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:00.976922 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:00.976926 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:00.976946 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:00.977007 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:00.977023 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:00.977169 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:00.977350 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:43:00.977407 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:43:00.979131 8122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } }
I20260811 01:43:00.979689 8122 leader_election.cc:302] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 965604ce123d462b89e59995ba1332b5; no voters:
I20260811 01:43:00.980253 8122 leader_election.cc:288] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:00.980419 8132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:00.981232 8132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [term 1 LEADER]: Becoming Leader. State: Replica: 965604ce123d462b89e59995ba1332b5, State: Running, Role: LEADER
I20260811 01:43:00.981869 8132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } }
I20260811 01:43:00.982695 8122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:00.984910 8134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 965604ce123d462b89e59995ba1332b5. Latest consensus state: current_term: 1 leader_uuid: "965604ce123d462b89e59995ba1332b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } } }
I20260811 01:43:00.985319 8134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:00.985884 8133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "965604ce123d462b89e59995ba1332b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "965604ce123d462b89e59995ba1332b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34527 } } }
I20260811 01:43:00.986639 8133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:00.987288 8137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:00.993511 8137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:01.003676 8137 catalog_manager.cc:1347] Generated new cluster ID: 54b79389750143a3af01c462a658fe52
I20260811 01:43:01.003832 8137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:01.021243 8137 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:01.022826 8137 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:01.031322 8137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 965604ce123d462b89e59995ba1332b5: Generated new TSK 0
I20260811 01:43:01.032291 8137 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:01.042671 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8050
W20260811 01:43:01.044498 8114 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50447
W20260811 01:43:01.045302 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8050: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:01.045480 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8050
W20260811 01:43:01.065900 8034 connection.cc:535] client connection to 127.0.0.1:34527 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34527): Connection reset by peer (error 104)
2026-08-11T01:43:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2145 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:01 dist-test-slave-0kls krb5kdc[8153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:01 dist-test-slave-0kls krb5kdc[8153](info): set up 2 sockets
Aug 11 01:43:01 dist-test-slave-0kls krb5kdc[8153](info): commencing operation
krb5kdc: starting...
W20260811 01:43:02.225755 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:02 dist-test-slave-0kls krb5kdc[8153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:02.565819 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:02.923942 8166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:02.924347 8166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:02.924528 8166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:02.931968 8166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:02.932163 8166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:02.932281 8166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:02.932400 8166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:02.932495 8166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:02.942900 8166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33877
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:02.944358 8166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:02.945837 8166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:02.958755 8171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:02.958942 8172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:02.958755 8174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:02.959771 8166 server_base.cc:1034] running on GCE node
I20260811 01:43:02.960660 8166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:02.962309 8166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:02.963609 8166 hybrid_clock.cc:648] HybridClock initialized: now 1786412582963551 us; error 48 us; skew 500 ppm
I20260811 01:43:02.964008 8166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:02 dist-test-slave-0kls krb5kdc[8153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412582, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:02.967355 8166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:02.969110 8166 webserver.cc:460] Webserver started at http://127.0.0.1:33527/ using document root <none> and password file <none>
I20260811 01:43:02.969908 8166 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:02.970052 8166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:02.970376 8166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:02.973516 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "970164f4969547fa87f5e61eb9afc0d2"
format_stamp: "Formatted at 2026-08-11 01:43:02 on dist-test-slave-0kls"
server_key: "d709ad3be4e33d726357fea6be77aabe"
server_key_iv: "e9b41843844a9fb6698df6ae87a2f0d7"
server_key_version: "encryptionkey@0"
I20260811 01:43:02.974463 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "970164f4969547fa87f5e61eb9afc0d2"
format_stamp: "Formatted at 2026-08-11 01:43:02 on dist-test-slave-0kls"
server_key: "d709ad3be4e33d726357fea6be77aabe"
server_key_iv: "e9b41843844a9fb6698df6ae87a2f0d7"
server_key_version: "encryptionkey@0"
I20260811 01:43:02.980001 8166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 01:43:02.983829 8181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:02.985356 8166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 01:43:02.985558 8166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "970164f4969547fa87f5e61eb9afc0d2"
format_stamp: "Formatted at 2026-08-11 01:43:02 on dist-test-slave-0kls"
server_key: "d709ad3be4e33d726357fea6be77aabe"
server_key_iv: "e9b41843844a9fb6698df6ae87a2f0d7"
server_key_version: "encryptionkey@0"
I20260811 01:43:02.985775 8166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:02.991946 8166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:02.996448 8166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:02.996768 8166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:03.016603 8166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33877
I20260811 01:43:03.016696 8238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33877 every 8 connection(s)
I20260811 01:43:03.018191 8166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:03.020463 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8166
I20260811 01:43:03.020671 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:03.021270 17936 external_mini_cluster.cc:1428] Setting key fd238711cec91758497dd48c945d8094
I20260811 01:43:03.023171 8239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:03.029424 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:03.023329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33131 (local address 127.0.0.1:33877)
0811 01:43:03.024199 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:03.024211 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:03.024252 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:43:03.025918 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:03.025943 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:03.026307 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:03.026646 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:03.027779 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:03.027785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:03.027798 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:03.027812 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:03.027889 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:03.027908 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:03.028110 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:03.028220 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 01:43:03.028441 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":408,"threads_started":1}
I20260811 01:43:03.033392 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:03.036909 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2: Bootstrap starting.
I20260811 01:43:03.041651 8239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:03.042495 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:03.039397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55933 (local address 127.0.0.1:33877)
0811 01:43:03.039575 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:03.039579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:03.039964 (+ 385us) server_negotiation.cc:407] Connection header received
0811 01:43:03.040139 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:03.040143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:03.040193 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:03.040280 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:03.041601 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:03.041606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:03.041609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:03.041626 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:03.041675 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:03.041693 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:03.041940 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:03.042070 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 01:43:03.042135 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 01:43:03.043087 8239 log.cc:824] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:03.046217 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2: No bootstrap required, opened a new log
I20260811 01:43:03.053464 8239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } }
I20260811 01:43:03.053920 8239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:03.054036 8239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970164f4969547fa87f5e61eb9afc0d2, State: Initialized, Role: FOLLOWER
I20260811 01:43:03.054670 8239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } }
I20260811 01:43:03.054956 8239 raft_consensus.cc:388] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:03.055119 8239 raft_consensus.cc:482] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:03.055318 8239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:03.057569 8239 raft_consensus.cc:504] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } }
I20260811 01:43:03.058203 8239 leader_election.cc:302] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 970164f4969547fa87f5e61eb9afc0d2; no voters:
I20260811 01:43:03.058823 8239 leader_election.cc:288] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:03.058974 8250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:03.060312 8250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [term 1 LEADER]: Becoming Leader. State: Replica: 970164f4969547fa87f5e61eb9afc0d2, State: Running, Role: LEADER
I20260811 01:43:03.060846 8250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } }
I20260811 01:43:03.061252 8239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:03.063923 8251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "970164f4969547fa87f5e61eb9afc0d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } } }
I20260811 01:43:03.064342 8251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:03.064782 8252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 970164f4969547fa87f5e61eb9afc0d2. Latest consensus state: current_term: 1 leader_uuid: "970164f4969547fa87f5e61eb9afc0d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970164f4969547fa87f5e61eb9afc0d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33877 } } }
I20260811 01:43:03.066126 8252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:03.066756 8260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:03.071687 8260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:03.081020 8260 catalog_manager.cc:1347] Generated new cluster ID: 5818c72574d24ca7a4843a8a12c94e96
I20260811 01:43:03.081154 8260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:03.099474 8260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:03.100023 8260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:03.107206 8260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 970164f4969547fa87f5e61eb9afc0d2: Generated new TSK 0
I20260811 01:43:03.108264 8260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:03.113049 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8166
W20260811 01:43:03.114377 8233 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33131
W20260811 01:43:03.115087 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8166: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:03.115249 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8166
2026-08-11T01:43:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:03 dist-test-slave-0kls krb5kdc[8272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:03 dist-test-slave-0kls krb5kdc[8272](info): set up 2 sockets
Aug 11 01:43:03 dist-test-slave-0kls krb5kdc[8272](info): commencing operation
krb5kdc: starting...
W20260811 01:43:04.323199 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:04 dist-test-slave-0kls krb5kdc[8272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:04.657119 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37915
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:05.008177 8286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:05.008490 8286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:05.008682 8286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:05.016197 8286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:05.016320 8286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:05.016420 8286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:05.016543 8286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:05.016607 8286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:05.026911 8286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:05.028357 8286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:05.029758 8286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:05.042573 8292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:05.042541 8295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:05.042610 8293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:05.043599 8286 server_base.cc:1034] running on GCE node
I20260811 01:43:05.044430 8286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:05.046072 8286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:05.047317 8286 hybrid_clock.cc:648] HybridClock initialized: now 1786412585047276 us; error 39 us; skew 500 ppm
I20260811 01:43:05.047708 8286 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:05 dist-test-slave-0kls krb5kdc[8272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412585, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:05.051221 8286 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:05.052934 8286 webserver.cc:460] Webserver started at http://127.0.0.1:34777/ using document root <none> and password file <none>
I20260811 01:43:05.053700 8286 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:05.053884 8286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:05.054229 8286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:05.057384 8286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e508c63282184fcea37abd4fd068de5d"
format_stamp: "Formatted at 2026-08-11 01:43:05 on dist-test-slave-0kls"
server_key: "4a2e9e0291f8abf6a624d213906393b2"
server_key_iv: "86b300d6a88ff812c63a903dfc50560e"
server_key_version: "encryptionkey@0"
I20260811 01:43:05.058243 8286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e508c63282184fcea37abd4fd068de5d"
format_stamp: "Formatted at 2026-08-11 01:43:05 on dist-test-slave-0kls"
server_key: "4a2e9e0291f8abf6a624d213906393b2"
server_key_iv: "86b300d6a88ff812c63a903dfc50560e"
server_key_version: "encryptionkey@0"
I20260811 01:43:05.063684 8286 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:43:05.067479 8302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:05.068878 8286 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:43:05.069089 8286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e508c63282184fcea37abd4fd068de5d"
format_stamp: "Formatted at 2026-08-11 01:43:05 on dist-test-slave-0kls"
server_key: "4a2e9e0291f8abf6a624d213906393b2"
server_key_iv: "86b300d6a88ff812c63a903dfc50560e"
server_key_version: "encryptionkey@0"
I20260811 01:43:05.069332 8286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:05.089314 8286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:05.093497 8286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:05.093883 8286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:05.113677 8286 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37915
I20260811 01:43:05.113773 8356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37915 every 8 connection(s)
I20260811 01:43:05.115142 8286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:05.119110 8357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:05.120456 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8286
I20260811 01:43:05.120668 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:05.121127 17936 external_mini_cluster.cc:1428] Setting key 6004b428bbd281dc8c0ef839ba49b998
I20260811 01:43:05.133766 8357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d: Bootstrap starting.
Aug 11 01:43:05 dist-test-slave-0kls krb5kdc[8272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:43:05.137517 8357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:05.138756 8357 log.cc:824] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:05.142150 8357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d: No bootstrap required, opened a new log
I20260811 01:43:05.146075 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:05.123051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43521 (local address 127.0.0.1:37915)
0811 01:43:05.123940 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:05.123954 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:05.124004 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:43:05.125612 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:05.125636 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:05.126126 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:05.126457 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:05.128382 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:05.129654 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:05.131568 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:05.132239 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:05.132371 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:05.137288 (+ 4917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:05.137297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:05.137312 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:05.137351 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:05.141165 (+ 3814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:05.141875 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:05.141883 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:05.141891 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:05.142156 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:05.142602 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:05.142608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:05.142611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:05.143394 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:05.143707 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:05.144098 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 01:43:05.144583 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":434,"threads_started":1}
I20260811 01:43:05.150007 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:05.151716 8357 raft_consensus.cc:348] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } }
I20260811 01:43:05.152184 8357 raft_consensus.cc:374] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:05.152271 8357 raft_consensus.cc:729] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e508c63282184fcea37abd4fd068de5d, State: Initialized, Role: FOLLOWER
I20260811 01:43:05.153047 8357 consensus_queue.cc:260] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } }
I20260811 01:43:05.153406 8357 raft_consensus.cc:388] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:05.153584 8357 raft_consensus.cc:482] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:05.153776 8357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:05.157485 8357 raft_consensus.cc:504] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } }
I20260811 01:43:05.158248 8357 leader_election.cc:302] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e508c63282184fcea37abd4fd068de5d; no voters:
I20260811 01:43:05.159190 8357 leader_election.cc:288] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:05.159343 8368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:05.162230 8357 sys_catalog.cc:564] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:05.166119 8368 raft_consensus.cc:686] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [term 1 LEADER]: Becoming Leader. State: Replica: e508c63282184fcea37abd4fd068de5d, State: Running, Role: LEADER
I20260811 01:43:05.167076 8368 consensus_queue.cc:237] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } }
I20260811 01:43:05.170831 8370 sys_catalog.cc:455] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e508c63282184fcea37abd4fd068de5d. Latest consensus state: current_term: 1 leader_uuid: "e508c63282184fcea37abd4fd068de5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } } }
I20260811 01:43:05.171306 8370 sys_catalog.cc:458] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:05.172418 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:05.154855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48257 (local address 127.0.0.1:37915)
0811 01:43:05.155114 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:05.155124 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:05.155611 (+ 487us) server_negotiation.cc:407] Connection header received
0811 01:43:05.155814 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:05.155818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:05.155888 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:05.155971 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:05.158179 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:05.159352 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:05.161114 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:05.161710 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:05.161901 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:05.164865 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:05.164872 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:05.164881 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:05.164917 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:05.168327 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:05.169069 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:05.169076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:05.169080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:05.169290 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:05.169839 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:05.169845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:05.169850 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:05.170319 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:05.170580 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:05.171766 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0811 01:43:05.172057 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:43:05.174410 8369 sys_catalog.cc:455] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e508c63282184fcea37abd4fd068de5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e508c63282184fcea37abd4fd068de5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37915 } } }
I20260811 01:43:05.174716 8369 sys_catalog.cc:458] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:05.175709 8377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:05.180846 8377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:05.190716 8377 catalog_manager.cc:1347] Generated new cluster ID: 618f05abd0b9490eb5db2f92056147fd
I20260811 01:43:05.190848 8377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:05.209508 8377 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:05.210942 8377 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:05.229578 8377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e508c63282184fcea37abd4fd068de5d: Generated new TSK 0
I20260811 01:43:05.230769 8377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:05.246940 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8286
I20260811 01:43:05.248484 8352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:05.343384 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8286
2026-08-11T01:43:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2227 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:05 dist-test-slave-0kls krb5kdc[8390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:05 dist-test-slave-0kls krb5kdc[8390](info): set up 2 sockets
Aug 11 01:43:05 dist-test-slave-0kls krb5kdc[8390](info): commencing operation
krb5kdc: starting...
W20260811 01:43:06.534663 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:06 dist-test-slave-0kls krb5kdc[8390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:06.875367 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46545
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:07.229279 8403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:07.229554 8403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:07.229770 8403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:07.237075 8403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:07.237249 8403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:07.237353 8403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:07.237478 8403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:07.237557 8403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:07.247807 8403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:07.249261 8403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:07.250774 8403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:07.263965 8412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:07.263965 8410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:07.263989 8409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:07.264690 8403 server_base.cc:1034] running on GCE node
I20260811 01:43:07.265573 8403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:07.267094 8403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:07.268335 8403 hybrid_clock.cc:648] HybridClock initialized: now 1786412587268301 us; error 50 us; skew 500 ppm
I20260811 01:43:07.268707 8403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:07 dist-test-slave-0kls krb5kdc[8390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412587, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:07.276940 8403 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:07.278715 8403 webserver.cc:460] Webserver started at http://127.0.0.1:42025/ using document root <none> and password file <none>
I20260811 01:43:07.279471 8403 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:07.279629 8403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:07.279982 8403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:07.283226 8403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "3daee88567d6476bb098741bcbd8f14b"
format_stamp: "Formatted at 2026-08-11 01:43:07 on dist-test-slave-0kls"
server_key: "dcec627f8a8c01736a8ba5ec978b6600"
server_key_iv: "164f24a885b8b1d1b7fa765bccfd8c93"
server_key_version: "encryptionkey@0"
I20260811 01:43:07.284046 8403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "3daee88567d6476bb098741bcbd8f14b"
format_stamp: "Formatted at 2026-08-11 01:43:07 on dist-test-slave-0kls"
server_key: "dcec627f8a8c01736a8ba5ec978b6600"
server_key_iv: "164f24a885b8b1d1b7fa765bccfd8c93"
server_key_version: "encryptionkey@0"
I20260811 01:43:07.289529 8403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:43:07.293143 8419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:07.294581 8403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:07.294776 8403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "3daee88567d6476bb098741bcbd8f14b"
format_stamp: "Formatted at 2026-08-11 01:43:07 on dist-test-slave-0kls"
server_key: "dcec627f8a8c01736a8ba5ec978b6600"
server_key_iv: "164f24a885b8b1d1b7fa765bccfd8c93"
server_key_version: "encryptionkey@0"
I20260811 01:43:07.294986 8403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:07.310678 8403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:07.315412 8403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:07.315732 8403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:07.335855 8403 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46545
I20260811 01:43:07.335877 8471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46545 every 8 connection(s)
I20260811 01:43:07.337380 8403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:07.339624 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8403
I20260811 01:43:07.339852 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:07.340341 17936 external_mini_cluster.cc:1428] Setting key f6c64855a0a62b5940a18fc6bda14c2a
I20260811 01:43:07.342123 8472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:07.354398 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:07.342368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39987 (local address 127.0.0.1:46545)
0811 01:43:07.343228 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:07.343240 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:07.343282 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:43:07.344862 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:07.344891 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:07.345294 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:07.345624 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:07.346322 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:07.347699 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:07.349629 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:07.350387 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:07.350526 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:07.351876 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:07.351884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:07.351902 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:07.352515 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:07.352603 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:07.352632 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:07.352726 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:07.352969 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 01:43:07.353327 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":418,"threads_started":1}
I20260811 01:43:07.355818 8472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b: Bootstrap starting.
I20260811 01:43:07.358361 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:07.359262 8472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:07.360322 8472 log.cc:824] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:07.364060 8472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b: No bootstrap required, opened a new log
I20260811 01:43:07.369513 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:07.363148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47931 (local address 127.0.0.1:46545)
0811 01:43:07.363397 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:07.363405 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:07.363829 (+ 424us) server_negotiation.cc:407] Connection header received
0811 01:43:07.364019 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:07.364023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:07.364097 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:07.364228 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:07.364852 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:07.365606 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:07.367006 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:07.367490 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:07.367629 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:07.368744 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:07.368749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:07.368752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:07.368773 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:07.368814 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:07.368832 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:07.368939 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:07.369095 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 01:43:07.369195 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:43:07.372586 8472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } }
I20260811 01:43:07.373018 8472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:07.373131 8472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3daee88567d6476bb098741bcbd8f14b, State: Initialized, Role: FOLLOWER
I20260811 01:43:07.373857 8472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } }
I20260811 01:43:07.374208 8472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:07.374382 8472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:07.374591 8472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:07.376856 8472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } }
I20260811 01:43:07.377401 8472 leader_election.cc:302] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3daee88567d6476bb098741bcbd8f14b; no voters:
I20260811 01:43:07.378185 8472 leader_election.cc:288] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:07.378309 8483 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:07.379184 8483 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [term 1 LEADER]: Becoming Leader. State: Replica: 3daee88567d6476bb098741bcbd8f14b, State: Running, Role: LEADER
I20260811 01:43:07.379839 8483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } }
I20260811 01:43:07.380492 8472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:07.383222 8484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3daee88567d6476bb098741bcbd8f14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } } }
I20260811 01:43:07.383212 8485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3daee88567d6476bb098741bcbd8f14b. Latest consensus state: current_term: 1 leader_uuid: "3daee88567d6476bb098741bcbd8f14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daee88567d6476bb098741bcbd8f14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46545 } } }
I20260811 01:43:07.383749 8484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:07.383757 8485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:07.388991 8492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:07.394135 8492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:07.404172 8492 catalog_manager.cc:1347] Generated new cluster ID: dd9581fafce149ea9b6d210b51530cf9
I20260811 01:43:07.404313 8492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:07.431272 8492 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:07.432904 8492 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:07.444183 8492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3daee88567d6476bb098741bcbd8f14b: Generated new TSK 0
I20260811 01:43:07.445291 8492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:07.459141 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8403
W20260811 01:43:07.460690 8467 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39987
W20260811 01:43:07.461488 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8403: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:07.461655 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8403
2026-08-11T01:43:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2118 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:07 dist-test-slave-0kls krb5kdc[8507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:07 dist-test-slave-0kls krb5kdc[8507](info): set up 2 sockets
Aug 11 01:43:07 dist-test-slave-0kls krb5kdc[8507](info): commencing operation
krb5kdc: starting...
W20260811 01:43:08.664294 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:08 dist-test-slave-0kls krb5kdc[8507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:09.009398 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41495
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:09.361960 8522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:09.362310 8522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:09.362526 8522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:09.370114 8522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:09.370262 8522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:09.370366 8522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:09.370469 8522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:09.370559 8522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:09.381191 8522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:09.382586 8522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:09.383908 8522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:09.396256 8528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:09.396337 8529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:09.396299 8531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:09.397284 8522 server_base.cc:1034] running on GCE node
I20260811 01:43:09.398198 8522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:09.399677 8522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:09.400951 8522 hybrid_clock.cc:648] HybridClock initialized: now 1786412589400896 us; error 46 us; skew 500 ppm
I20260811 01:43:09.401329 8522 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:09 dist-test-slave-0kls krb5kdc[8507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412589, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:09.404517 8522 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:09.406064 8522 webserver.cc:460] Webserver started at http://127.0.0.1:45009/ using document root <none> and password file <none>
I20260811 01:43:09.406723 8522 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:09.406828 8522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:09.407111 8522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:09.410238 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "b25936e6b031414fb6bc4a5fe80473c6"
format_stamp: "Formatted at 2026-08-11 01:43:09 on dist-test-slave-0kls"
server_key: "976a9e44abec6b137d4b805e6d94e08d"
server_key_iv: "2abf2f986007065559dc8aafc6d52be5"
server_key_version: "encryptionkey@0"
I20260811 01:43:09.410980 8522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "b25936e6b031414fb6bc4a5fe80473c6"
format_stamp: "Formatted at 2026-08-11 01:43:09 on dist-test-slave-0kls"
server_key: "976a9e44abec6b137d4b805e6d94e08d"
server_key_iv: "2abf2f986007065559dc8aafc6d52be5"
server_key_version: "encryptionkey@0"
I20260811 01:43:09.416319 8522 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:43:09.419921 8538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:09.421339 8522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:43:09.421499 8522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "b25936e6b031414fb6bc4a5fe80473c6"
format_stamp: "Formatted at 2026-08-11 01:43:09 on dist-test-slave-0kls"
server_key: "976a9e44abec6b137d4b805e6d94e08d"
server_key_iv: "2abf2f986007065559dc8aafc6d52be5"
server_key_version: "encryptionkey@0"
I20260811 01:43:09.421693 8522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:09.427743 8522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:09.431762 8522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:09.432018 8522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:09.451404 8522 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41495
I20260811 01:43:09.451457 8590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41495 every 8 connection(s)
I20260811 01:43:09.452893 8522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:09.456859 8591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:09.462626 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8522
I20260811 01:43:09.462832 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:09.463425 17936 external_mini_cluster.cc:1428] Setting key bd40b46e81c641395761aa7447becaa7
I20260811 01:43:09.468664 8591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6: Bootstrap starting.
I20260811 01:43:09.471558 8594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:09.465416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34471 (local address 127.0.0.1:41495)
0811 01:43:09.466356 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:09.466368 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:09.466412 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:43:09.468112 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:09.468135 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:09.468471 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:09.468858 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:09.469951 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:09.469958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:09.469971 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:09.469985 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:09.470046 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:09.470079 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:09.470340 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:09.470484 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 01:43:09.470670 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":446,"threads_started":1}
I20260811 01:43:09.472470 8591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:09.473663 8591 log.cc:824] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:09.475871 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:09.476943 8591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6: No bootstrap required, opened a new log
I20260811 01:43:09.483505 8594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:09.480534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59207 (local address 127.0.0.1:41495)
0811 01:43:09.480769 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:09.480779 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:09.481356 (+ 577us) server_negotiation.cc:407] Connection header received
0811 01:43:09.481571 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:09.481595 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:09.481648 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:09.481770 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:09.482762 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:09.482767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:09.482771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:09.482795 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:09.482848 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:09.482866 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:09.483004 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:09.483132 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 01:43:09.483204 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:43:09.485898 8591 raft_consensus.cc:348] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } }
I20260811 01:43:09.486304 8591 raft_consensus.cc:374] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:09.486418 8591 raft_consensus.cc:729] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25936e6b031414fb6bc4a5fe80473c6, State: Initialized, Role: FOLLOWER
I20260811 01:43:09.487054 8591 consensus_queue.cc:260] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } }
I20260811 01:43:09.487334 8591 raft_consensus.cc:388] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:09.487483 8591 raft_consensus.cc:482] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:09.487675 8591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:09.490144 8591 raft_consensus.cc:504] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } }
I20260811 01:43:09.490739 8591 leader_election.cc:302] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b25936e6b031414fb6bc4a5fe80473c6; no voters:
I20260811 01:43:09.491487 8591 leader_election.cc:288] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:09.491665 8602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:09.492393 8602 raft_consensus.cc:686] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [term 1 LEADER]: Becoming Leader. State: Replica: b25936e6b031414fb6bc4a5fe80473c6, State: Running, Role: LEADER
I20260811 01:43:09.493013 8602 consensus_queue.cc:237] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } }
I20260811 01:43:09.493824 8591 sys_catalog.cc:564] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:09.495754 8603 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b25936e6b031414fb6bc4a5fe80473c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } } }
I20260811 01:43:09.496186 8603 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:09.496410 8605 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b25936e6b031414fb6bc4a5fe80473c6. Latest consensus state: current_term: 1 leader_uuid: "b25936e6b031414fb6bc4a5fe80473c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25936e6b031414fb6bc4a5fe80473c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41495 } } }
I20260811 01:43:09.496734 8605 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:09.499075 8608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:09.504161 8608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:09.512918 8608 catalog_manager.cc:1347] Generated new cluster ID: 231a392f7d3e47f79005d67adee73977
I20260811 01:43:09.513049 8608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:09.539120 8608 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:09.539616 8608 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:09.550165 8608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b25936e6b031414fb6bc4a5fe80473c6: Generated new TSK 0
I20260811 01:43:09.551236 8608 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:09.565805 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8522
W20260811 01:43:09.567018 8586 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34471
W20260811 01:43:09.567718 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8522: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:09.567869 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8522
2026-08-11T01:43:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2105 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:09 dist-test-slave-0kls krb5kdc[8625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:09 dist-test-slave-0kls krb5kdc[8625](info): set up 2 sockets
Aug 11 01:43:09 dist-test-slave-0kls krb5kdc[8625](info): commencing operation
krb5kdc: starting...
W20260811 01:43:10.756035 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:10 dist-test-slave-0kls krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:11.122874 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46313
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:11.483567 8638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:11.483924 8638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:11.484099 8638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:11.491711 8638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:11.491844 8638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:11.491932 8638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:11.492038 8638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:11.492120 8638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:11.502511 8638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:11.503921 8638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:11.505322 8638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:11.518180 8647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:11.518302 8644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:11.518280 8645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:11.518986 8638 server_base.cc:1034] running on GCE node
I20260811 01:43:11.519881 8638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:11.521526 8638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:11.522806 8638 hybrid_clock.cc:648] HybridClock initialized: now 1786412591522757 us; error 38 us; skew 500 ppm
I20260811 01:43:11.523275 8638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:11 dist-test-slave-0kls krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412591, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:11.526877 8638 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:11.528570 8638 webserver.cc:460] Webserver started at http://127.0.0.1:36685/ using document root <none> and password file <none>
I20260811 01:43:11.529359 8638 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:11.529529 8638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:11.529960 8638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:11.533331 8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "c970c0a7fe154a69b596d2bb22c4057a"
format_stamp: "Formatted at 2026-08-11 01:43:11 on dist-test-slave-0kls"
server_key: "a8345cdf9c0878992fa0249f2c8071b7"
server_key_iv: "3ad3c6b314b5edae0a04c640862ba78c"
server_key_version: "encryptionkey@0"
I20260811 01:43:11.534281 8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "c970c0a7fe154a69b596d2bb22c4057a"
format_stamp: "Formatted at 2026-08-11 01:43:11 on dist-test-slave-0kls"
server_key: "a8345cdf9c0878992fa0249f2c8071b7"
server_key_iv: "3ad3c6b314b5edae0a04c640862ba78c"
server_key_version: "encryptionkey@0"
I20260811 01:43:11.540442 8638 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:43:11.544436 8654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:11.546209 8638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:11.546492 8638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "c970c0a7fe154a69b596d2bb22c4057a"
format_stamp: "Formatted at 2026-08-11 01:43:11 on dist-test-slave-0kls"
server_key: "a8345cdf9c0878992fa0249f2c8071b7"
server_key_iv: "3ad3c6b314b5edae0a04c640862ba78c"
server_key_version: "encryptionkey@0"
I20260811 01:43:11.546718 8638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:11.567206 8638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:11.571619 8638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:11.571908 8638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:11.592181 8638 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46313
I20260811 01:43:11.592303 8708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46313 every 8 connection(s)
I20260811 01:43:11.593695 8638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:11.597720 8709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:11.597726 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8638
I20260811 01:43:11.597970 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:11.598448 17936 external_mini_cluster.cc:1428] Setting key 821e76f5b62252b3058a0eb506aa5b9d
I20260811 01:43:11.613906 8709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a: Bootstrap starting.
Aug 11 01:43:11 dist-test-slave-0kls krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:43:11.617427 8709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:11.619014 8709 log.cc:824] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:11.622119 8709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a: No bootstrap required, opened a new log
I20260811 01:43:11.624255 8712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:11.600321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:55767 (local address 127.0.0.1:46313)
0811 01:43:11.601398 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:11.601411 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:11.601459 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:43:11.603124 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:11.603148 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:11.603568 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:11.603924 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:11.605999 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:11.607968 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:11.609931 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:11.610776 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:11.610939 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:11.616122 (+ 5183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:11.616131 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:11.616146 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:11.616190 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:11.619830 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:11.620675 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:11.620684 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:11.620693 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:11.620866 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:11.621421 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:11.621426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:11.621429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:11.621991 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:11.622374 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:11.622858 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 01:43:11.623229 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":504,"threads_started":1}
I20260811 01:43:11.628239 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:11.630527 8709 raft_consensus.cc:348] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } }
I20260811 01:43:11.631064 8709 raft_consensus.cc:374] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:11.631258 8709 raft_consensus.cc:729] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c970c0a7fe154a69b596d2bb22c4057a, State: Initialized, Role: FOLLOWER
I20260811 01:43:11.631940 8709 consensus_queue.cc:260] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } }
I20260811 01:43:11.632189 8709 raft_consensus.cc:388] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:11.632345 8709 raft_consensus.cc:482] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:11.632571 8709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:11.636142 8709 raft_consensus.cc:504] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } }
I20260811 01:43:11.636724 8709 leader_election.cc:302] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c970c0a7fe154a69b596d2bb22c4057a; no voters:
I20260811 01:43:11.637408 8709 leader_election.cc:288] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:11.637521 8720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:11.639906 8709 sys_catalog.cc:564] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:11.640455 8720 raft_consensus.cc:686] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [term 1 LEADER]: Becoming Leader. State: Replica: c970c0a7fe154a69b596d2bb22c4057a, State: Running, Role: LEADER
I20260811 01:43:11.641057 8720 consensus_queue.cc:237] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } }
I20260811 01:43:11.645946 8722 sys_catalog.cc:455] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c970c0a7fe154a69b596d2bb22c4057a. Latest consensus state: current_term: 1 leader_uuid: "c970c0a7fe154a69b596d2bb22c4057a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } } }
I20260811 01:43:11.647469 8722 sys_catalog.cc:458] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:11.646842 8721 sys_catalog.cc:455] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c970c0a7fe154a69b596d2bb22c4057a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c970c0a7fe154a69b596d2bb22c4057a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46313 } } }
I20260811 01:43:11.648073 8721 sys_catalog.cc:458] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:11.657207 8712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:11.632769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:58359 (local address 127.0.0.1:46313)
0811 01:43:11.632996 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:11.633005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:11.633432 (+ 427us) server_negotiation.cc:407] Connection header received
0811 01:43:11.633633 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:11.633637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:11.633703 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:11.633843 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:11.635775 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:11.636617 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:11.638530 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:11.639187 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:11.639302 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:11.643515 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:11.643527 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:11.643533 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:11.643572 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:11.651507 (+ 7935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:11.653065 (+ 1558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:11.653075 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:11.653081 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:11.653298 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:11.654130 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:11.654138 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:11.654144 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:11.654678 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:11.656323 (+ 1645us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:11.656552 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 01:43:11.656773 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 01:43:11.659162 8729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:11.663954 8729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:11.672603 8729 catalog_manager.cc:1347] Generated new cluster ID: b855dbe8cee04a85a2593741b0728372
I20260811 01:43:11.672735 8729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:11.688941 8729 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:11.690352 8729 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:11.706712 8729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c970c0a7fe154a69b596d2bb22c4057a: Generated new TSK 0
I20260811 01:43:11.707584 8729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:11.713753 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8638
I20260811 01:43:11.715225 8704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:11.808754 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8638
W20260811 01:43:11.828171 8623 connection.cc:535] client connection to 127.0.0.1:46313 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46313): Connection reset by peer (error 104)
2026-08-11T01:43:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2238 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:11 dist-test-slave-0kls krb5kdc[8743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:11 dist-test-slave-0kls krb5kdc[8743](info): set up 2 sockets
Aug 11 01:43:11 dist-test-slave-0kls krb5kdc[8743](info): commencing operation
krb5kdc: starting...
W20260811 01:43:13.008574 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:13 dist-test-slave-0kls krb5kdc[8743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:13.374763 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:13.745769 8756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:13.746213 8756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:13.746395 8756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:13.753980 8756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:13.754091 8756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:13.754230 8756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:13.754335 8756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:13.754415 8756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:13.765151 8756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:13.766614 8756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:13.768040 8756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:13.780280 8765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:13.780428 8762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:13.780385 8763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:13.781538 8756 server_base.cc:1034] running on GCE node
I20260811 01:43:13.782452 8756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:13.783978 8756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:13.785223 8756 hybrid_clock.cc:648] HybridClock initialized: now 1786412593785189 us; error 56 us; skew 500 ppm
I20260811 01:43:13.785595 8756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:13 dist-test-slave-0kls krb5kdc[8743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412593, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:13.792188 8756 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:13.794031 8756 webserver.cc:460] Webserver started at http://127.0.0.1:34511/ using document root <none> and password file <none>
I20260811 01:43:13.794808 8756 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:13.794919 8756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:13.795184 8756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:13.798276 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "09cd97c9a3014f8caca42c35124de921"
format_stamp: "Formatted at 2026-08-11 01:43:13 on dist-test-slave-0kls"
server_key: "d37549fe9e1ae5f223145b5d3ea5cc47"
server_key_iv: "6d7d24c2abb7c8834b4c484a01ec0e9c"
server_key_version: "encryptionkey@0"
I20260811 01:43:13.799042 8756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "09cd97c9a3014f8caca42c35124de921"
format_stamp: "Formatted at 2026-08-11 01:43:13 on dist-test-slave-0kls"
server_key: "d37549fe9e1ae5f223145b5d3ea5cc47"
server_key_iv: "6d7d24c2abb7c8834b4c484a01ec0e9c"
server_key_version: "encryptionkey@0"
I20260811 01:43:13.804332 8756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 01:43:13.807852 8773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:13.809188 8756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:43:13.809333 8756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "09cd97c9a3014f8caca42c35124de921"
format_stamp: "Formatted at 2026-08-11 01:43:13 on dist-test-slave-0kls"
server_key: "d37549fe9e1ae5f223145b5d3ea5cc47"
server_key_iv: "6d7d24c2abb7c8834b4c484a01ec0e9c"
server_key_version: "encryptionkey@0"
I20260811 01:43:13.809496 8756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:13.821736 8756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:13.826056 8756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:13.826301 8756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:13.846514 8756 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40805
I20260811 01:43:13.846556 8828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40805 every 8 connection(s)
I20260811 01:43:13.848330 8756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:13.851164 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8756
I20260811 01:43:13.851387 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:13.851963 17936 external_mini_cluster.cc:1428] Setting key f95f63d4b430cfd8093e7177148fe66d
I20260811 01:43:13.853443 8829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:13.868250 8832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:13.854338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:36271 (local address 127.0.0.1:40805)
0811 01:43:13.855272 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:13.855286 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:13.855331 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:43:13.857373 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:13.857404 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:13.858042 (+ 638us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:13.858511 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:13.859311 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:13.860830 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:13.863008 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:13.863810 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:13.863964 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:13.865510 (+ 1546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:13.865518 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:13.865535 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:13.866262 (+ 727us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:13.866369 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:13.866396 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:13.866538 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:13.866907 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 01:43:13.867141 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":449,"threads_started":1}
I20260811 01:43:13.869643 8829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921: Bootstrap starting.
I20260811 01:43:13.873489 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:13.874472 8829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:13.876094 8829 log.cc:824] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:13.879894 8829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921: No bootstrap required, opened a new log
I20260811 01:43:13.886145 8832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:13.878874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:41481 (local address 127.0.0.1:40805)
0811 01:43:13.879081 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:13.879088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:13.879552 (+ 464us) server_negotiation.cc:407] Connection header received
0811 01:43:13.879728 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:13.879734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:13.879834 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:13.879969 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:13.880583 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:13.881773 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:13.883164 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:13.883909 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:13.884045 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:13.885263 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:13.885269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:13.885274 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:13.885302 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:13.885361 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:13.885381 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:13.885506 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:13.885681 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 01:43:13.885738 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:43:13.889406 8829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } }
I20260811 01:43:13.889874 8829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:13.889990 8829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd97c9a3014f8caca42c35124de921, State: Initialized, Role: FOLLOWER
I20260811 01:43:13.890702 8829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } }
I20260811 01:43:13.890930 8829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:13.891167 8829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:13.891371 8829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:13.894197 8829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } }
I20260811 01:43:13.894824 8829 leader_election.cc:302] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd97c9a3014f8caca42c35124de921; no voters:
I20260811 01:43:13.895535 8829 leader_election.cc:288] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:13.895744 8839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:13.896692 8839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [term 1 LEADER]: Becoming Leader. State: Replica: 09cd97c9a3014f8caca42c35124de921, State: Running, Role: LEADER
I20260811 01:43:13.897348 8839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } }
I20260811 01:43:13.898149 8829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:13.900501 8841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09cd97c9a3014f8caca42c35124de921. Latest consensus state: current_term: 1 leader_uuid: "09cd97c9a3014f8caca42c35124de921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } } }
I20260811 01:43:13.900921 8841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:13.902076 8840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09cd97c9a3014f8caca42c35124de921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd97c9a3014f8caca42c35124de921" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40805 } } }
I20260811 01:43:13.902448 8840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:13.903077 8844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:13.909075 8844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:13.920534 8844 catalog_manager.cc:1347] Generated new cluster ID: 2579e2aabf8b4e90b554b8dbd147ae01
I20260811 01:43:13.920689 8844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:13.939538 8844 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:13.941562 8844 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:13.948875 8844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09cd97c9a3014f8caca42c35124de921: Generated new TSK 0
I20260811 01:43:13.950009 8844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:13.960564 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8756
W20260811 01:43:13.962082 8823 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.104:36271
W20260811 01:43:13.962966 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8756: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:13.963130 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8756
W20260811 01:43:13.985817 8741 connection.cc:535] client connection to 127.0.0.1:40805 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40805): Connection reset by peer (error 104)
2026-08-11T01:43:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2157 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:14 dist-test-slave-0kls krb5kdc[8862](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:14 dist-test-slave-0kls krb5kdc[8862](info): set up 2 sockets
Aug 11 01:43:14 dist-test-slave-0kls krb5kdc[8862](info): commencing operation
krb5kdc: starting...
W20260811 01:43:15.181433 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:15 dist-test-slave-0kls krb5kdc[8862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:15.546056 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:15.923813 8876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:15.924212 8876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:15.924379 8876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:15.931953 8876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:15.932140 8876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:15.932256 8876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:15.932371 8876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:15.932448 8876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:15.943181 8876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:15.944702 8876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:15.946219 8876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:15.959653 8884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:15.959681 8886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:15.959805 8883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:15.960525 8876 server_base.cc:1034] running on GCE node
I20260811 01:43:15.961452 8876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:15.963148 8876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:15.964411 8876 hybrid_clock.cc:648] HybridClock initialized: now 1786412595964356 us; error 52 us; skew 500 ppm
I20260811 01:43:15.964836 8876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:15 dist-test-slave-0kls krb5kdc[8862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412595, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:15.968478 8876 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:15.970542 8876 webserver.cc:460] Webserver started at http://127.0.0.1:33823/ using document root <none> and password file <none>
I20260811 01:43:15.971366 8876 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:15.971535 8876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:15.971933 8876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:15.975523 8876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "ce0e7ee97c2b4df58977844c5020eb16"
format_stamp: "Formatted at 2026-08-11 01:43:15 on dist-test-slave-0kls"
server_key: "73abd77474811c304a4f8b02e50cf768"
server_key_iv: "83c6450390bce2721b5bf7bf5e5ec343"
server_key_version: "encryptionkey@0"
I20260811 01:43:15.976502 8876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "ce0e7ee97c2b4df58977844c5020eb16"
format_stamp: "Formatted at 2026-08-11 01:43:15 on dist-test-slave-0kls"
server_key: "73abd77474811c304a4f8b02e50cf768"
server_key_iv: "83c6450390bce2721b5bf7bf5e5ec343"
server_key_version: "encryptionkey@0"
I20260811 01:43:15.983281 8876 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:43:15.987565 8893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:15.989275 8876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:43:15.989519 8876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "ce0e7ee97c2b4df58977844c5020eb16"
format_stamp: "Formatted at 2026-08-11 01:43:15 on dist-test-slave-0kls"
server_key: "73abd77474811c304a4f8b02e50cf768"
server_key_iv: "83c6450390bce2721b5bf7bf5e5ec343"
server_key_version: "encryptionkey@0"
I20260811 01:43:15.989821 8876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:15.996487 8876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:16.001513 8876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:16.002097 8876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:16.028209 8876 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38987
I20260811 01:43:16.028251 8948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38987 every 8 connection(s)
I20260811 01:43:16.030155 8876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:16.033452 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8876
I20260811 01:43:16.033684 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:16.034490 17936 external_mini_cluster.cc:1428] Setting key 5981fd5e5eab361a6065a128cf26dd42
I20260811 01:43:16.035676 8949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:16.044436 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:16.036537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:50005 (local address 127.0.0.1:38987)
0811 01:43:16.037495 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:16.037508 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:16.037557 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:43:16.040208 (+ 2651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:16.040251 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:16.040723 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:16.041208 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:16.042481 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:16.042488 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:16.042503 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:16.042520 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:16.042604 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:16.042625 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:16.042939 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:16.043123 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 01:43:16.043358 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":414,"threads_started":1}
I20260811 01:43:16.048799 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:16.051117 8949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16: Bootstrap starting.
I20260811 01:43:16.055332 8949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:16.056855 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:16.053903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:36863 (local address 127.0.0.1:38987)
0811 01:43:16.054121 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:16.054127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:16.054478 (+ 351us) server_negotiation.cc:407] Connection header received
0811 01:43:16.054719 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:16.054724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:16.054785 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:16.054901 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:16.056087 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:16.056091 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:16.056095 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:16.056111 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:16.056157 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:16.056172 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:16.056270 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:16.056451 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:43:16.056512 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 01:43:16.056943 8949 log.cc:824] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:16.060289 8949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16: No bootstrap required, opened a new log
I20260811 01:43:16.068281 8949 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260811 01:43:16.068779 8949 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:16.068912 8949 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce0e7ee97c2b4df58977844c5020eb16, State: Initialized, Role: FOLLOWER
I20260811 01:43:16.069554 8949 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260811 01:43:16.069875 8949 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:16.070047 8949 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:16.070251 8949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:16.072716 8949 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260811 01:43:16.073364 8949 leader_election.cc:302] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce0e7ee97c2b4df58977844c5020eb16; no voters:
I20260811 01:43:16.074247 8949 leader_election.cc:288] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:16.074473 8959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:16.075259 8959 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [term 1 LEADER]: Becoming Leader. State: Replica: ce0e7ee97c2b4df58977844c5020eb16, State: Running, Role: LEADER
I20260811 01:43:16.075894 8959 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260811 01:43:16.076717 8949 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:16.079950 8960 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce0e7ee97c2b4df58977844c5020eb16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } } }
I20260811 01:43:16.080374 8960 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:16.080935 8961 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce0e7ee97c2b4df58977844c5020eb16. Latest consensus state: current_term: 1 leader_uuid: "ce0e7ee97c2b4df58977844c5020eb16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce0e7ee97c2b4df58977844c5020eb16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } } }
I20260811 01:43:16.081260 8961 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:16.082226 8968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:16.088341 8968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:16.106587 8968 catalog_manager.cc:1347] Generated new cluster ID: 79886dd6cc3d48e8afa972af3c313324
I20260811 01:43:16.106740 8968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:16.124678 8968 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:16.125294 8968 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:16.137035 8968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce0e7ee97c2b4df58977844c5020eb16: Generated new TSK 0
I20260811 01:43:16.138080 8968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:16.143006 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8876
W20260811 01:43:16.145354 8943 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.104:50005
W20260811 01:43:16.146422 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8876: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:16.146656 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8876
2026-08-11T01:43:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2182 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:16 dist-test-slave-0kls krb5kdc[8981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:16 dist-test-slave-0kls krb5kdc[8981](info): set up 2 sockets
Aug 11 01:43:16 dist-test-slave-0kls krb5kdc[8981](info): commencing operation
krb5kdc: starting...
W20260811 01:43:17.367410 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:17 dist-test-slave-0kls krb5kdc[8981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:17.709399 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:18.088989 8994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:18.089295 8994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:18.089499 8994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:18.096879 8994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:18.097028 8994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:18.097141 8994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:18.097255 8994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:18.097338 8994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:18.107939 8994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:18.109344 8994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:18.110785 8994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:18.123044 9000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:18.123085 9002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:18.123114 8999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:18.124158 8994 server_base.cc:1034] running on GCE node
I20260811 01:43:18.125048 8994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:18.126583 8994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:18.127825 8994 hybrid_clock.cc:648] HybridClock initialized: now 1786412598127756 us; error 31 us; skew 500 ppm
I20260811 01:43:18.128217 8994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:18 dist-test-slave-0kls krb5kdc[8981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412598, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:18.131536 8994 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:18.133162 8994 webserver.cc:460] Webserver started at http://127.0.0.1:46105/ using document root <none> and password file <none>
I20260811 01:43:18.133961 8994 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:18.134104 8994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:18.134433 8994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:18.137528 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224"
format_stamp: "Formatted at 2026-08-11 01:43:18 on dist-test-slave-0kls"
server_key: "59153945d853be3c226daa62f50a919c"
server_key_iv: "a7715dee27ee6afd287d43cce72b19a0"
server_key_version: "encryptionkey@0"
I20260811 01:43:18.138489 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224"
format_stamp: "Formatted at 2026-08-11 01:43:18 on dist-test-slave-0kls"
server_key: "59153945d853be3c226daa62f50a919c"
server_key_iv: "a7715dee27ee6afd287d43cce72b19a0"
server_key_version: "encryptionkey@0"
I20260811 01:43:18.143879 8994 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:43:18.147464 9009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:18.148829 8994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:43:18.149032 8994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224"
format_stamp: "Formatted at 2026-08-11 01:43:18 on dist-test-slave-0kls"
server_key: "59153945d853be3c226daa62f50a919c"
server_key_iv: "a7715dee27ee6afd287d43cce72b19a0"
server_key_version: "encryptionkey@0"
I20260811 01:43:18.149232 8994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:18.176673 8994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:18.181403 8994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:18.181721 8994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:18.201514 8994 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45559
I20260811 01:43:18.201557 9063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45559 every 8 connection(s)
I20260811 01:43:18.202998 8994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:18.204576 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 8994
I20260811 01:43:18.204774 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:18.205412 17936 external_mini_cluster.cc:1428] Setting key 733f136ff279941608478048df20bbb6
I20260811 01:43:18.208032 9064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:43:18 dist-test-slave-0kls krb5kdc[8981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:43:18.222543 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224: Bootstrap starting.
I20260811 01:43:18.227252 9064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:18.228583 9064 log.cc:824] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:18.232308 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224: No bootstrap required, opened a new log
I20260811 01:43:18.232496 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:18.207697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:43581 (local address 127.0.0.1:45559)
0811 01:43:18.208621 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:18.208633 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:18.208682 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:43:18.210613 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:18.210637 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:18.211080 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:18.211457 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:18.213329 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:18.214958 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:18.216743 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:18.217517 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:18.217678 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:18.223160 (+ 5482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:18.223186 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:18.223208 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:18.223262 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:18.227528 (+ 4266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:18.228489 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:18.228498 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:18.228506 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:18.228748 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:18.229313 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:18.229320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:18.229323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:18.229997 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:18.230348 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:18.230793 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 01:43:18.231136 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":706,"thread_start_us":445,"threads_started":1}
I20260811 01:43:18.236778 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:18.241313 9064 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } }
I20260811 01:43:18.241901 9064 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:18.242057 9064 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f0a7c1c1bf4e16b45fd73466bc8224, State: Initialized, Role: FOLLOWER
I20260811 01:43:18.242688 9064 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } }
I20260811 01:43:18.242993 9064 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:18.243144 9064 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:18.243345 9064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:18.246447 9064 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } }
I20260811 01:43:18.247062 9064 leader_election.cc:302] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3f0a7c1c1bf4e16b45fd73466bc8224; no voters:
I20260811 01:43:18.247860 9064 leader_election.cc:288] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:18.247992 9075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:18.249287 9075 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [term 1 LEADER]: Becoming Leader. State: Replica: e3f0a7c1c1bf4e16b45fd73466bc8224, State: Running, Role: LEADER
I20260811 01:43:18.249997 9075 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } }
I20260811 01:43:18.250581 9064 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:18.253695 9076 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } } }
I20260811 01:43:18.254257 9076 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:18.256230 9077 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f0a7c1c1bf4e16b45fd73466bc8224. Latest consensus state: current_term: 1 leader_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f0a7c1c1bf4e16b45fd73466bc8224" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45559 } } }
I20260811 01:43:18.256605 9077 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:18.258029 9080 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:18.259708 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:18.241469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:54475 (local address 127.0.0.1:45559)
0811 01:43:18.241681 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:18.241690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:18.242380 (+ 690us) server_negotiation.cc:407] Connection header received
0811 01:43:18.242454 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:18.242458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:18.242544 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:18.242621 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:18.244607 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:18.245397 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:18.247185 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:18.247730 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:18.247891 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:18.250989 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:18.250993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:18.250997 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:18.251031 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:18.254959 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:18.256251 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:18.256258 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:18.256262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:18.256492 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:18.257254 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:18.257258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:18.257261 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:18.257748 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:18.259008 (+ 1260us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:18.259189 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:43:18.259325 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:43:18.265630 9080 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:18.275249 9080 catalog_manager.cc:1347] Generated new cluster ID: 5690cd6e04914654a0bdb15406f53f82
I20260811 01:43:18.275389 9080 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:18.311991 9080 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:18.313392 9080 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:18.323156 9080 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3f0a7c1c1bf4e16b45fd73466bc8224: Generated new TSK 0
I20260811 01:43:18.324018 9080 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:18.332937 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 8994
I20260811 01:43:18.334331 9059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:18.431079 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 8994
W20260811 01:43:18.453630 8979 connection.cc:535] client connection to 127.0.0.1:45559 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45559): Connection reset by peer (error 104)
2026-08-11T01:43:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2285 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:18 dist-test-slave-0kls krb5kdc[9099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:18 dist-test-slave-0kls krb5kdc[9099](info): set up 2 sockets
Aug 11 01:43:18 dist-test-slave-0kls krb5kdc[9099](info): commencing operation
krb5kdc: starting...
W20260811 01:43:19.631557 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:19 dist-test-slave-0kls krb5kdc[9099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:19.982024 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33295
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:20.366779 9112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:20.367100 9112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:20.367285 9112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:20.374823 9112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:20.374979 9112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:20.375072 9112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:20.375165 9112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:20.375233 9112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:20.385690 9112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33295
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:20.387138 9112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:20.388540 9112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:20.400959 9118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:20.400897 9119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:20.400924 9122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:20.402037 9112 server_base.cc:1034] running on GCE node
I20260811 01:43:20.402868 9112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:20.404357 9112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:20.405573 9112 hybrid_clock.cc:648] HybridClock initialized: now 1786412600405534 us; error 28 us; skew 500 ppm
I20260811 01:43:20.406015 9112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:20 dist-test-slave-0kls krb5kdc[9099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412600, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:20.412990 9112 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:20.414701 9112 webserver.cc:460] Webserver started at http://127.0.0.1:33913/ using document root <none> and password file <none>
I20260811 01:43:20.415480 9112 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:20.415632 9112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:20.415958 9112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:20.419242 9112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc"
format_stamp: "Formatted at 2026-08-11 01:43:20 on dist-test-slave-0kls"
server_key: "e5f852d3484e69c1ac7dd03bfa7686e2"
server_key_iv: "bcbc745c34b26f4a4feb516a14b3859d"
server_key_version: "encryptionkey@0"
I20260811 01:43:20.420087 9112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc"
format_stamp: "Formatted at 2026-08-11 01:43:20 on dist-test-slave-0kls"
server_key: "e5f852d3484e69c1ac7dd03bfa7686e2"
server_key_iv: "bcbc745c34b26f4a4feb516a14b3859d"
server_key_version: "encryptionkey@0"
I20260811 01:43:20.425637 9112 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:43:20.429265 9129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:20.430657 9112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:20.430869 9112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc"
format_stamp: "Formatted at 2026-08-11 01:43:20 on dist-test-slave-0kls"
server_key: "e5f852d3484e69c1ac7dd03bfa7686e2"
server_key_iv: "bcbc745c34b26f4a4feb516a14b3859d"
server_key_version: "encryptionkey@0"
I20260811 01:43:20.431087 9112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:20.470754 9112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:20.475471 9112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:20.475808 9112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:20.496239 9112 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33295
I20260811 01:43:20.496270 9182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33295 every 8 connection(s)
I20260811 01:43:20.497710 9112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:20.501721 9183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:20.503283 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9112
I20260811 01:43:20.503485 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:20.504046 17936 external_mini_cluster.cc:1428] Setting key cfd278f9626443eb8657fa11d05cacc8
I20260811 01:43:20.515452 9183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc: Bootstrap starting.
I20260811 01:43:20.517745 9186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:20.506188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:45259 (local address 127.0.0.1:33295)
0811 01:43:20.507033 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:20.507045 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:20.507088 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:43:20.508801 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:20.508835 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:20.509282 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:20.509724 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:20.510311 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:20.511584 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:20.513033 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:20.513755 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:20.514015 (+ 260us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:20.515363 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:20.515370 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:20.515385 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:20.516020 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:20.516099 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:20.516124 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:20.516305 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:20.516588 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 01:43:20.516781 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":358,"threads_started":1}
I20260811 01:43:20.518963 9183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:20.520061 9183 log.cc:824] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:20.521937 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:20.523751 9183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc: No bootstrap required, opened a new log
I20260811 01:43:20.534709 9186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:20.527550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:55503 (local address 127.0.0.1:33295)
0811 01:43:20.527757 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:20.527764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:20.528299 (+ 535us) server_negotiation.cc:407] Connection header received
0811 01:43:20.528437 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:20.528448 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:20.528541 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:20.528666 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:20.529198 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:20.530452 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:20.531799 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:20.532543 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:20.532678 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:20.533829 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:20.533839 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:20.533845 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:20.533867 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:20.533933 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:20.533957 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:20.534078 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:20.534256 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 01:43:20.534314 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:43:20.534371 9183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } }
I20260811 01:43:20.534968 9183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:20.535105 9183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7971fa87dfbb4ea68ebd97b09bdf7efc, State: Initialized, Role: FOLLOWER
I20260811 01:43:20.535895 9183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } }
I20260811 01:43:20.536214 9183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:20.536386 9183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:20.536597 9183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:20.539114 9183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } }
I20260811 01:43:20.539700 9183 leader_election.cc:302] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7971fa87dfbb4ea68ebd97b09bdf7efc; no voters:
I20260811 01:43:20.540398 9183 leader_election.cc:288] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:20.540601 9194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:20.541831 9194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [term 1 LEADER]: Becoming Leader. State: Replica: 7971fa87dfbb4ea68ebd97b09bdf7efc, State: Running, Role: LEADER
I20260811 01:43:20.542554 9194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } }
I20260811 01:43:20.542991 9183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:20.545166 9195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } } }
I20260811 01:43:20.545814 9195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:20.548162 9196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7971fa87dfbb4ea68ebd97b09bdf7efc. Latest consensus state: current_term: 1 leader_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7971fa87dfbb4ea68ebd97b09bdf7efc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33295 } } }
I20260811 01:43:20.548481 9196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:20.549813 9200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:20.556408 9200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:20.565985 9200 catalog_manager.cc:1347] Generated new cluster ID: 04b860a4c5ae4cf287d95b318cf14514
I20260811 01:43:20.566166 9200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:20.579257 9200 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:20.580662 9200 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:20.588593 9200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7971fa87dfbb4ea68ebd97b09bdf7efc: Generated new TSK 0
I20260811 01:43:20.589473 9200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:20.599506 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9112
W20260811 01:43:20.600839 9178 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.104:45259
W20260811 01:43:20.601711 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9112: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:20.601920 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9112
W20260811 01:43:20.623710 9097 connection.cc:535] client connection to 127.0.0.1:33295 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33295): Connection reset by peer (error 104)
2026-08-11T01:43:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2174 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:20 dist-test-slave-0kls krb5kdc[9216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:20 dist-test-slave-0kls krb5kdc[9216](info): set up 2 sockets
Aug 11 01:43:20 dist-test-slave-0kls krb5kdc[9216](info): commencing operation
krb5kdc: starting...
W20260811 01:43:21.796382 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:22 dist-test-slave-0kls krb5kdc[9216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:43:22.142287 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:22.497186 9230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:22.497519 9230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:22.497617 9230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:22.505096 9230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:22.505262 9230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:22.505321 9230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:22.505378 9230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:22.505415 9230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:22.515733 9230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41103
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:22.517117 9230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:22.518595 9230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:22.531479 9241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:22.531673 9238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:22.531620 9239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:22.532609 9230 server_base.cc:1034] running on GCE node
I20260811 01:43:22.533516 9230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:22.535125 9230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:22.536379 9230 hybrid_clock.cc:648] HybridClock initialized: now 1786412602536341 us; error 42 us; skew 500 ppm
I20260811 01:43:22.536760 9230 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:22 dist-test-slave-0kls krb5kdc[9216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412602, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:22.540102 9230 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:43:22.541831 9230 webserver.cc:460] Webserver started at http://127.0.0.1:42291/ using document root <none> and password file <none>
I20260811 01:43:22.542600 9230 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:22.542758 9230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:22.543094 9230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:22.546368 9230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "1924f61d23994a73ac8830dfc9aa8e1e"
format_stamp: "Formatted at 2026-08-11 01:43:22 on dist-test-slave-0kls"
server_key: "eb739df058bf6a9cd7db3e9d5d20dd19"
server_key_iv: "37a74c83b33c8cf36597d6de8a0c32a8"
server_key_version: "encryptionkey@0"
I20260811 01:43:22.547191 9230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "1924f61d23994a73ac8830dfc9aa8e1e"
format_stamp: "Formatted at 2026-08-11 01:43:22 on dist-test-slave-0kls"
server_key: "eb739df058bf6a9cd7db3e9d5d20dd19"
server_key_iv: "37a74c83b33c8cf36597d6de8a0c32a8"
server_key_version: "encryptionkey@0"
I20260811 01:43:22.552700 9230 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 01:43:22.556439 9250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:22.557965 9230 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:43:22.558173 9230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "1924f61d23994a73ac8830dfc9aa8e1e"
format_stamp: "Formatted at 2026-08-11 01:43:22 on dist-test-slave-0kls"
server_key: "eb739df058bf6a9cd7db3e9d5d20dd19"
server_key_iv: "37a74c83b33c8cf36597d6de8a0c32a8"
server_key_version: "encryptionkey@0"
I20260811 01:43:22.558386 9230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:22.564390 9230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:22.568725 9230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:22.569052 9230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:22.589205 9230 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41103
I20260811 01:43:22.589303 9302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41103 every 8 connection(s)
I20260811 01:43:22.590854 9230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:22.595003 9304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:22.596405 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9230
I20260811 01:43:22.596624 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:22.597129 17936 external_mini_cluster.cc:1428] Setting key c159b7da729540b6fdf114b7770af733
I20260811 01:43:22.606271 9307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:22.599234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:39415 (local address 127.0.0.1:41103)
0811 01:43:22.600080 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:22.600093 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:22.600141 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:43:22.602354 (+ 2213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:22.602385 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:22.602790 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:22.603269 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:22.604406 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:22.604412 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:22.604427 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:22.604442 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:22.604502 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:22.604527 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:22.604805 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:22.604955 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 01:43:22.605159 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":346,"threads_started":1}
I20260811 01:43:22.610298 9304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e: Bootstrap starting.
I20260811 01:43:22.610579 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:22.613605 9304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:22.614748 9304 log.cc:824] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:22.618072 9304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e: No bootstrap required, opened a new log
I20260811 01:43:22.618592 9307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:22.615848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.104:54717 (local address 127.0.0.1:41103)
0811 01:43:22.616062 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:22.616070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:22.616346 (+ 276us) server_negotiation.cc:407] Connection header received
0811 01:43:22.616574 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:22.616580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:22.616645 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:22.616760 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:22.617762 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:22.617768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:22.617773 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:22.617817 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:22.617870 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:22.617891 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:22.618037 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:22.618164 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:43:22.618240 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:43:22.625608 9304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260811 01:43:22.626093 9304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:22.626205 9304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1924f61d23994a73ac8830dfc9aa8e1e, State: Initialized, Role: FOLLOWER
I20260811 01:43:22.626868 9304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260811 01:43:22.627120 9304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:22.627285 9304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:22.627467 9304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:22.629776 9304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260811 01:43:22.630378 9304 leader_election.cc:302] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1924f61d23994a73ac8830dfc9aa8e1e; no voters:
I20260811 01:43:22.630981 9304 leader_election.cc:288] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:22.631170 9314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:22.631915 9314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [term 1 LEADER]: Becoming Leader. State: Replica: 1924f61d23994a73ac8830dfc9aa8e1e, State: Running, Role: LEADER
I20260811 01:43:22.632529 9314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260811 01:43:22.633193 9304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:22.636289 9316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1924f61d23994a73ac8830dfc9aa8e1e. Latest consensus state: current_term: 1 leader_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } } }
I20260811 01:43:22.636148 9315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1924f61d23994a73ac8830dfc9aa8e1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } } }
I20260811 01:43:22.637751 9316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:22.637815 9315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:22.639389 9321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:22.645442 9321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:22.656064 9321 catalog_manager.cc:1347] Generated new cluster ID: 0e3785a7cbf34fcda8ac482fafc5cd30
I20260811 01:43:22.656224 9321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:22.689448 9321 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:22.690047 9321 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:22.705436 9321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1924f61d23994a73ac8830dfc9aa8e1e: Generated new TSK 0
I20260811 01:43:22.706475 9321 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:22.712697 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9230
W20260811 01:43:22.714115 9298 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.104:39415
W20260811 01:43:22.714900 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9230: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:22.715168 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9230
2026-08-11T01:43:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2109 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:22 dist-test-slave-0kls krb5kdc[9336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:22 dist-test-slave-0kls krb5kdc[9336](info): set up 2 sockets
Aug 11 01:43:22 dist-test-slave-0kls krb5kdc[9336](info): commencing operation
krb5kdc: starting...
W20260811 01:43:23.915175 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.003s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:24 dist-test-slave-0kls krb5kdc[9336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:24.270517 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46643
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:46643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:24.638979 9350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:24.639297 9350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:24.639390 9350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:24.646618 9350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:24.646725 9350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:24.646780 9350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:24.646842 9350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:24.646885 9350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:24.657106 9350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:46643
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:46643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:24.658595 9350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:24.660082 9350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:24.674352 9358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:24.674299 9356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:24.674865 9355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:24.675253 9350 server_base.cc:1034] running on GCE node
I20260811 01:43:24.676283 9350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:24.678153 9350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:24.679468 9350 hybrid_clock.cc:648] HybridClock initialized: now 1786412604679389 us; error 78 us; skew 500 ppm
I20260811 01:43:24.679960 9350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:24 dist-test-slave-0kls krb5kdc[9336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412604, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:24.683873 9350 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:24.685870 9350 webserver.cc:460] Webserver started at http://127.17.132.62:41781/ using document root <none> and password file <none>
I20260811 01:43:24.686721 9350 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:24.686856 9350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:24.687168 9350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:24.690873 9350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "d529d8e875f34bf5bbc5521631650bb0"
format_stamp: "Formatted at 2026-08-11 01:43:24 on dist-test-slave-0kls"
server_key: "128e63279a03ef3e53cef60c33cb0a48"
server_key_iv: "09a59eb50e9ff22c593a6741d8be615b"
server_key_version: "encryptionkey@0"
I20260811 01:43:24.691843 9350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "d529d8e875f34bf5bbc5521631650bb0"
format_stamp: "Formatted at 2026-08-11 01:43:24 on dist-test-slave-0kls"
server_key: "128e63279a03ef3e53cef60c33cb0a48"
server_key_iv: "09a59eb50e9ff22c593a6741d8be615b"
server_key_version: "encryptionkey@0"
I20260811 01:43:24.698199 9350 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:43:24.701969 9365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:24.703413 9350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:43:24.703575 9350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "d529d8e875f34bf5bbc5521631650bb0"
format_stamp: "Formatted at 2026-08-11 01:43:24 on dist-test-slave-0kls"
server_key: "128e63279a03ef3e53cef60c33cb0a48"
server_key_iv: "09a59eb50e9ff22c593a6741d8be615b"
server_key_version: "encryptionkey@0"
I20260811 01:43:24.703766 9350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:24.723071 9350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:24.727360 9350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:24.727629 9350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:24.747273 9350 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:46643
I20260811 01:43:24.747284 9418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:46643 every 8 connection(s)
I20260811 01:43:24.748761 9350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:24.752763 9419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:24.756418 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9350
I20260811 01:43:24.756610 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:24.757177 17936 external_mini_cluster.cc:1428] Setting key 38a4490db029c51479e4dc2619e12062
I20260811 01:43:24.766283 9419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0: Bootstrap starting.
I20260811 01:43:24.769903 9419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:24.771562 9419 log.cc:824] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:43:24 dist-test-slave-0kls krb5kdc[9336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:24.775566 9419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0: No bootstrap required, opened a new log
I20260811 01:43:24.781949 9423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:24.759029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38877 (local address 127.17.132.62:46643)
0811 01:43:24.759913 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:24.759925 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:24.759968 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:43:24.761702 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:24.761727 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:24.762231 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:24.762580 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:24.764647 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:24.766308 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:24.767742 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:24.768466 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:24.768673 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:24.774211 (+ 5538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:24.774220 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:24.774237 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:24.774277 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:24.777431 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:24.778379 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:24.778386 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:24.778392 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:24.778572 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:24.779081 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:24.779085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:24.779087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:24.779643 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:24.780038 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:24.780499 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 01:43:24.780842 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":412,"threads_started":1}
I20260811 01:43:24.784113 9419 raft_consensus.cc:348] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } }
I20260811 01:43:24.784483 9419 raft_consensus.cc:374] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:24.784596 9419 raft_consensus.cc:729] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d529d8e875f34bf5bbc5521631650bb0, State: Initialized, Role: FOLLOWER
I20260811 01:43:24.785265 9419 consensus_queue.cc:260] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } }
I20260811 01:43:24.785542 9419 raft_consensus.cc:388] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:24.785712 9419 raft_consensus.cc:482] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:24.785921 9419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:24.786646 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:24.788993 9419 raft_consensus.cc:504] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } }
I20260811 01:43:24.789598 9419 leader_election.cc:302] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d529d8e875f34bf5bbc5521631650bb0; no voters:
I20260811 01:43:24.790378 9419 leader_election.cc:288] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:24.790464 9426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:24.792196 9426 raft_consensus.cc:686] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [term 1 LEADER]: Becoming Leader. State: Replica: d529d8e875f34bf5bbc5521631650bb0, State: Running, Role: LEADER
I20260811 01:43:24.792721 9426 consensus_queue.cc:237] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } }
I20260811 01:43:24.793267 9419 sys_catalog.cc:564] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:24.795524 9429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d529d8e875f34bf5bbc5521631650bb0. Latest consensus state: current_term: 1 leader_uuid: "d529d8e875f34bf5bbc5521631650bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } } }
I20260811 01:43:24.795912 9429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:24.796471 9428 sys_catalog.cc:455] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d529d8e875f34bf5bbc5521631650bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d529d8e875f34bf5bbc5521631650bb0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 46643 } } }
I20260811 01:43:24.796785 9428 sys_catalog.cc:458] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:24.800458 9433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:24.808902 9433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:24.823451 9423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:24.802799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41039 (local address 127.17.132.62:46643)
0811 01:43:24.802971 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:24.802978 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:24.803597 (+ 619us) server_negotiation.cc:407] Connection header received
0811 01:43:24.803878 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:24.803887 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:24.804002 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:24.804150 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:24.806291 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:24.807792 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:24.809850 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:24.810497 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:24.810644 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:24.814214 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:24.814221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:24.814225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:24.814272 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:24.818748 (+ 4476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:24.819891 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:24.819897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:24.819901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:24.820043 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:24.820683 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:24.820689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:24.820692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:24.821152 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:24.821446 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:24.822844 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0811 01:43:24.823039 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:43:24.827668 9433 catalog_manager.cc:1347] Generated new cluster ID: 67126756ca0c4ff9994362e820e22777
I20260811 01:43:24.827848 9433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:24.841454 9433 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:24.842885 9433 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:24.850142 9433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d529d8e875f34bf5bbc5521631650bb0: Generated new TSK 0
I20260811 01:43:24.851011 9433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:24.865839 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9350
I20260811 01:43:24.867838 9414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:24.959916 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9350
W20260811 01:43:24.981945 9334 connection.cc:535] client connection to 127.17.132.62:46643 recv error: Network error: failed to read from TLS socket (remote: 127.17.132.62:46643): Connection reset by peer (error 104)
2026-08-11T01:43:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2243 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:25 dist-test-slave-0kls krb5kdc[9453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:25 dist-test-slave-0kls krb5kdc[9453](info): set up 2 sockets
Aug 11 01:43:25 dist-test-slave-0kls krb5kdc[9453](info): commencing operation
krb5kdc: starting...
W20260811 01:43:26.146798 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:26 dist-test-slave-0kls krb5kdc[9453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:26.498134 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45011
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:45011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:26.854537 9467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:26.854882 9467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:26.855041 9467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:26.862537 9467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:26.862687 9467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:26.862783 9467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:26.862890 9467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:26.862965 9467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:26.873098 9467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:45011
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:45011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:26.874565 9467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:26.876045 9467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:26.888751 9472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:26.888898 9475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:26.888897 9473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:26.889916 9467 server_base.cc:1034] running on GCE node
I20260811 01:43:26.890808 9467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:26.892392 9467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:26.893632 9467 hybrid_clock.cc:648] HybridClock initialized: now 1786412606893586 us; error 45 us; skew 500 ppm
I20260811 01:43:26.894052 9467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:26 dist-test-slave-0kls krb5kdc[9453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412606, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:26.902812 9467 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:26.904505 9467 webserver.cc:460] Webserver started at http://127.17.132.62:37165/ using document root <none> and password file <none>
I20260811 01:43:26.905285 9467 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:26.905437 9467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:26.905771 9467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:26.909065 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0"
format_stamp: "Formatted at 2026-08-11 01:43:26 on dist-test-slave-0kls"
server_key: "c7779c47bad9764e47bce09ae938987b"
server_key_iv: "e0f5327ee771f74fb6e6a9592022ba37"
server_key_version: "encryptionkey@0"
I20260811 01:43:26.909953 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0"
format_stamp: "Formatted at 2026-08-11 01:43:26 on dist-test-slave-0kls"
server_key: "c7779c47bad9764e47bce09ae938987b"
server_key_iv: "e0f5327ee771f74fb6e6a9592022ba37"
server_key_version: "encryptionkey@0"
I20260811 01:43:26.915323 9467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:43:26.918988 9482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:26.920362 9467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:43:26.920562 9467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0"
format_stamp: "Formatted at 2026-08-11 01:43:26 on dist-test-slave-0kls"
server_key: "c7779c47bad9764e47bce09ae938987b"
server_key_iv: "e0f5327ee771f74fb6e6a9592022ba37"
server_key_version: "encryptionkey@0"
I20260811 01:43:26.920768 9467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:26.935286 9467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:26.939729 9467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:26.940048 9467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:26.959599 9467 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:45011
I20260811 01:43:26.959633 9538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:45011 every 8 connection(s)
I20260811 01:43:26.961076 9467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:26.961719 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9467
I20260811 01:43:26.961952 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:26.962661 17936 external_mini_cluster.cc:1428] Setting key ed5db66d90f35c646d96cab0c312b251
I20260811 01:43:26.965718 9539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:26.976817 9542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:26.964606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53695 (local address 127.17.132.62:45011)
0811 01:43:26.965456 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:26.965467 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:26.965509 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:43:26.967220 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:26.967243 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:26.967616 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:26.967946 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:26.968655 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:26.970092 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:26.972093 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:26.972816 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:26.972958 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:26.974381 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:26.974389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:26.974404 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:26.974984 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:26.975077 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:26.975106 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:26.975309 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:26.975598 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:43:26.975774 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":421,"threads_started":1}
I20260811 01:43:26.978937 9539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0: Bootstrap starting.
I20260811 01:43:26.980933 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:26.982561 9539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:26.983575 9539 log.cc:824] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:26.986740 9539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0: No bootstrap required, opened a new log
I20260811 01:43:26.993700 9542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:26.985418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50793 (local address 127.17.132.62:45011)
0811 01:43:26.985597 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:26.985603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:26.987434 (+ 1831us) server_negotiation.cc:407] Connection header received
0811 01:43:26.987599 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:26.987603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:26.987687 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:26.987792 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:26.988389 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:26.989578 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:26.990933 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:26.991493 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:26.991639 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:26.992840 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:26.992844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:26.992848 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:26.992866 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:26.992922 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:26.992937 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:26.993073 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:26.993257 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 01:43:26.993325 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:43:26.995824 9539 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } }
I20260811 01:43:26.996249 9539 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:26.996371 9539 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbbaa8f60c7f4b76906cf2b26f3031e0, State: Initialized, Role: FOLLOWER
I20260811 01:43:26.996968 9539 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } }
I20260811 01:43:26.997229 9539 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:26.997394 9539 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:26.997575 9539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:27.000269 9539 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } }
I20260811 01:43:27.000888 9539 leader_election.cc:302] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbbaa8f60c7f4b76906cf2b26f3031e0; no voters:
I20260811 01:43:27.001564 9539 leader_election.cc:288] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:27.001725 9549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:27.002596 9549 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [term 1 LEADER]: Becoming Leader. State: Replica: bbbaa8f60c7f4b76906cf2b26f3031e0, State: Running, Role: LEADER
I20260811 01:43:27.003187 9549 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } }
I20260811 01:43:27.004015 9539 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:27.006184 9552 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbbaa8f60c7f4b76906cf2b26f3031e0. Latest consensus state: current_term: 1 leader_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } } }
I20260811 01:43:27.006222 9551 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbaa8f60c7f4b76906cf2b26f3031e0" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 45011 } } }
I20260811 01:43:27.006982 9552 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:27.006978 9551 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:27.012557 9558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:27.018603 9558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:27.029120 9558 catalog_manager.cc:1347] Generated new cluster ID: 654445fe91b64c71acfc44a4bd9efc60
I20260811 01:43:27.029281 9558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:27.058782 9558 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:27.060231 9558 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:27.070195 9558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbbaa8f60c7f4b76906cf2b26f3031e0: Generated new TSK 0
I20260811 01:43:27.071161 9558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:27.091095 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9467
W20260811 01:43:27.092526 9534 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53695
W20260811 01:43:27.093307 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9467: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:27.093452 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9467
W20260811 01:43:27.112000 9451 connection.cc:535] client connection to 127.17.132.62:45011 recv error: Network error: failed to read from TLS socket (remote: 127.17.132.62:45011): Connection reset by peer (error 104)
2026-08-11T01:43:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2130 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:27 dist-test-slave-0kls krb5kdc[9571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:27 dist-test-slave-0kls krb5kdc[9571](info): set up 2 sockets
Aug 11 01:43:27 dist-test-slave-0kls krb5kdc[9571](info): commencing operation
krb5kdc: starting...
W20260811 01:43:28.294821 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:28 dist-test-slave-0kls krb5kdc[9571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:28.641338 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:39461
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:39461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:28.999571 9584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:28.999917 9584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:29.000090 9584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:29.007681 9584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:29.007815 9584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:29.007937 9584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:29.008040 9584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:29.008119 9584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:29.019155 9584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:39461
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:39461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:29.020660 9584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:29.022133 9584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:29.035283 9590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:29.035332 9591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:29.035292 9593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:29.036523 9584 server_base.cc:1034] running on GCE node
I20260811 01:43:29.037433 9584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:29.039109 9584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:29.040397 9584 hybrid_clock.cc:648] HybridClock initialized: now 1786412609040343 us; error 45 us; skew 500 ppm
I20260811 01:43:29.040853 9584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:29 dist-test-slave-0kls krb5kdc[9571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:29.044620 9584 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:29.046695 9584 webserver.cc:460] Webserver started at http://127.17.132.62:46643/ using document root <none> and password file <none>
I20260811 01:43:29.047646 9584 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:29.047816 9584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:29.048177 9584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:29.052330 9584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "834f7db3abb340f098f92f5a47823669"
format_stamp: "Formatted at 2026-08-11 01:43:29 on dist-test-slave-0kls"
server_key: "b32dabdbe79ec42c4fdec7b015d5b1be"
server_key_iv: "6a06dbc52ba1ae093ddd489b3dec8ebc"
server_key_version: "encryptionkey@0"
I20260811 01:43:29.053329 9584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "834f7db3abb340f098f92f5a47823669"
format_stamp: "Formatted at 2026-08-11 01:43:29 on dist-test-slave-0kls"
server_key: "b32dabdbe79ec42c4fdec7b015d5b1be"
server_key_iv: "6a06dbc52ba1ae093ddd489b3dec8ebc"
server_key_version: "encryptionkey@0"
I20260811 01:43:29.059711 9584 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260811 01:43:29.064220 9601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:29.065881 9584 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:43:29.066090 9584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "834f7db3abb340f098f92f5a47823669"
format_stamp: "Formatted at 2026-08-11 01:43:29 on dist-test-slave-0kls"
server_key: "b32dabdbe79ec42c4fdec7b015d5b1be"
server_key_iv: "6a06dbc52ba1ae093ddd489b3dec8ebc"
server_key_version: "encryptionkey@0"
I20260811 01:43:29.066336 9584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:29.072587 9584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:29.077140 9584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:29.077471 9584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:29.098378 9584 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:39461
I20260811 01:43:29.098414 9655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:39461 every 8 connection(s)
I20260811 01:43:29.100272 9584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:29.104522 9656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:29.105392 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9584
I20260811 01:43:29.105619 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:29.106141 17936 external_mini_cluster.cc:1428] Setting key 990781f1cdb4ee0665f4ed9a3fff9b94
I20260811 01:43:29.115883 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:29.108137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53709 (local address 127.17.132.62:39461)
0811 01:43:29.109070 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:29.109088 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:29.109140 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:43:29.111700 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:29.111744 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:29.112248 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:29.112794 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:29.113832 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:29.113841 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:29.113859 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:29.113878 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:29.113951 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:29.113983 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:29.114207 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:29.114334 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:43:29.114554 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":397,"threads_started":1}
I20260811 01:43:29.119868 9656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669: Bootstrap starting.
I20260811 01:43:29.120056 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:29.123315 9656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:29.124482 9656 log.cc:824] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:29.127583 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:29.124866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59561 (local address 127.17.132.62:39461)
0811 01:43:29.125070 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:29.125079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:29.125464 (+ 385us) server_negotiation.cc:407] Connection header received
0811 01:43:29.125689 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:29.125694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:29.125755 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:29.125896 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:29.126905 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:29.126912 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:29.126916 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:29.126940 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:29.126980 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:29.126996 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:29.127118 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:29.127238 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 01:43:29.127311 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:43:29.128386 9656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669: No bootstrap required, opened a new log
I20260811 01:43:29.136694 9656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } }
I20260811 01:43:29.137140 9656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:29.137254 9656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 834f7db3abb340f098f92f5a47823669, State: Initialized, Role: FOLLOWER
I20260811 01:43:29.137900 9656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } }
I20260811 01:43:29.138152 9656 raft_consensus.cc:388] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:29.138300 9656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:29.138477 9656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:29.140795 9656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } }
I20260811 01:43:29.141333 9656 leader_election.cc:302] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 834f7db3abb340f098f92f5a47823669; no voters:
I20260811 01:43:29.142041 9656 leader_election.cc:288] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:29.142180 9666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:29.143932 9666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [term 1 LEADER]: Becoming Leader. State: Replica: 834f7db3abb340f098f92f5a47823669, State: Running, Role: LEADER
I20260811 01:43:29.144543 9666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } }
I20260811 01:43:29.144798 9656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:29.147389 9669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 834f7db3abb340f098f92f5a47823669. Latest consensus state: current_term: 1 leader_uuid: "834f7db3abb340f098f92f5a47823669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } } }
I20260811 01:43:29.148082 9669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:29.147488 9667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "834f7db3abb340f098f92f5a47823669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "834f7db3abb340f098f92f5a47823669" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 39461 } } }
I20260811 01:43:29.148679 9667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:29.150417 9675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:29.156201 9675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:29.165414 9675 catalog_manager.cc:1347] Generated new cluster ID: 37825e4f031f4e4aba42d4dc2e091976
I20260811 01:43:29.165557 9675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:29.186966 9675 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:29.187429 9675 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:29.195152 9675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 834f7db3abb340f098f92f5a47823669: Generated new TSK 0
I20260811 01:43:29.196017 9675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:29.209208 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9584
W20260811 01:43:29.210578 9651 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53709
W20260811 01:43:29.211319 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9584: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:29.211478 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9584
2026-08-11T01:43:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2121 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:29 dist-test-slave-0kls krb5kdc[9689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:29 dist-test-slave-0kls krb5kdc[9689](info): set up 2 sockets
Aug 11 01:43:29 dist-test-slave-0kls krb5kdc[9689](info): commencing operation
krb5kdc: starting...
W20260811 01:43:30.427264 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:30 dist-test-slave-0kls krb5kdc[9689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:30.785825 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40335
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:40335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:31.158656 9702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:31.159021 9702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:31.159204 9702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:31.166860 9702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:31.166994 9702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:31.167086 9702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:31.167182 9702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:31.167246 9702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:31.178339 9702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:40335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:40335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:31.179785 9702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:31.181155 9702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:31.194983 9707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:31.195015 9710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:31.195060 9708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:31.195695 9702 server_base.cc:1034] running on GCE node
I20260811 01:43:31.196782 9702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:31.198545 9702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:31.199853 9702 hybrid_clock.cc:648] HybridClock initialized: now 1786412611199796 us; error 64 us; skew 500 ppm
I20260811 01:43:31.200412 9702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:31 dist-test-slave-0kls krb5kdc[9689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412611, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:31.203999 9702 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:31.205729 9702 webserver.cc:460] Webserver started at http://127.17.132.62:46087/ using document root <none> and password file <none>
I20260811 01:43:31.206538 9702 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:31.206696 9702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:31.207028 9702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:31.210351 9702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "8e10eb9738274ab4aaef900729d77500"
format_stamp: "Formatted at 2026-08-11 01:43:31 on dist-test-slave-0kls"
server_key: "0f845f58561c2413a07ebb6df8ef2055"
server_key_iv: "7da1c85624bbfc5381abc219ab426d44"
server_key_version: "encryptionkey@0"
I20260811 01:43:31.211216 9702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "8e10eb9738274ab4aaef900729d77500"
format_stamp: "Formatted at 2026-08-11 01:43:31 on dist-test-slave-0kls"
server_key: "0f845f58561c2413a07ebb6df8ef2055"
server_key_iv: "7da1c85624bbfc5381abc219ab426d44"
server_key_version: "encryptionkey@0"
I20260811 01:43:31.216775 9702 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:43:31.220777 9717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:31.222361 9702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:31.222570 9702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "8e10eb9738274ab4aaef900729d77500"
format_stamp: "Formatted at 2026-08-11 01:43:31 on dist-test-slave-0kls"
server_key: "0f845f58561c2413a07ebb6df8ef2055"
server_key_iv: "7da1c85624bbfc5381abc219ab426d44"
server_key_version: "encryptionkey@0"
I20260811 01:43:31.222788 9702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:31.243846 9702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:31.248674 9702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:31.249007 9702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:31.269155 9702 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:40335
I20260811 01:43:31.269176 9770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:40335 every 8 connection(s)
I20260811 01:43:31.270714 9702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:31.273108 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9702
I20260811 01:43:31.273304 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:31.273885 17936 external_mini_cluster.cc:1428] Setting key 25ae75727c360e398a549147d2c50a7f
I20260811 01:43:31.275180 9771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:31.287184 9771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500: Bootstrap starting.
Aug 11 01:43:31 dist-test-slave-0kls krb5kdc[9689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:31.290674 9771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:31.291807 9771 log.cc:824] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:31.294909 9771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500: No bootstrap required, opened a new log
I20260811 01:43:31.296307 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:31.275861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50427 (local address 127.17.132.62:40335)
0811 01:43:31.276640 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:31.276652 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:31.276695 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:43:31.278377 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:31.278400 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:31.278797 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:31.279241 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:31.280780 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:31.282206 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:31.283455 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:31.284172 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:31.284375 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:31.288732 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:31.288740 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:31.288758 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:31.288803 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:31.292079 (+ 3276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:31.292823 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:31.292837 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:31.292843 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:31.293024 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:31.293483 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:31.293489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:31.293492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:31.294113 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:31.294415 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:31.294864 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 01:43:31.295302 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":354,"threads_started":1}
I20260811 01:43:31.300412 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:31.303989 9771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } }
I20260811 01:43:31.304423 9771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:31.304534 9771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e10eb9738274ab4aaef900729d77500, State: Initialized, Role: FOLLOWER
I20260811 01:43:31.305377 9771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } }
I20260811 01:43:31.305723 9771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:31.305966 9771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:31.306167 9771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:31.308529 9771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } }
I20260811 01:43:31.309211 9771 leader_election.cc:302] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e10eb9738274ab4aaef900729d77500; no voters:
I20260811 01:43:31.310019 9771 leader_election.cc:288] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:31.310125 9781 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:31.311635 9781 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [term 1 LEADER]: Becoming Leader. State: Replica: 8e10eb9738274ab4aaef900729d77500, State: Running, Role: LEADER
I20260811 01:43:31.312320 9781 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } }
I20260811 01:43:31.312736 9771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:31.315310 9782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e10eb9738274ab4aaef900729d77500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } } }
I20260811 01:43:31.315718 9782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:31.326728 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:31.305119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57141 (local address 127.17.132.62:40335)
0811 01:43:31.305419 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:31.305426 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:31.305954 (+ 528us) server_negotiation.cc:407] Connection header received
0811 01:43:31.306176 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:31.306180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:31.306291 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:31.306405 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:31.307896 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:31.308646 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:31.310675 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:31.311373 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:31.311492 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:31.315476 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:31.315486 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:31.315494 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:31.315556 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:31.320709 (+ 5153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:31.322053 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:31.322063 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:31.322069 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:31.322301 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:31.322899 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:31.322907 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:31.322913 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:31.323465 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:31.323818 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:31.325683 (+ 1865us) server_negotiation.cc:299] Negotiation successful
0811 01:43:31.326069 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260811 01:43:31.327171 9783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e10eb9738274ab4aaef900729d77500. Latest consensus state: current_term: 1 leader_uuid: "8e10eb9738274ab4aaef900729d77500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e10eb9738274ab4aaef900729d77500" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 40335 } } }
I20260811 01:43:31.328181 9783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:31.330816 9786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:31.337280 9786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:31.348070 9786 catalog_manager.cc:1347] Generated new cluster ID: ffd85c5cb6b74159969735c231d117bc
I20260811 01:43:31.348215 9786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:31.359704 9786 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:31.361253 9786 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:31.375588 9786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e10eb9738274ab4aaef900729d77500: Generated new TSK 0
I20260811 01:43:31.376516 9786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:31.382866 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9702
I20260811 01:43:31.384104 9766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:31.478021 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9702
2026-08-11T01:43:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2265 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:31 dist-test-slave-0kls krb5kdc[9804](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:31 dist-test-slave-0kls krb5kdc[9804](info): set up 2 sockets
Aug 11 01:43:31 dist-test-slave-0kls krb5kdc[9804](info): commencing operation
krb5kdc: starting...
W20260811 01:43:32.670977 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:32 dist-test-slave-0kls krb5kdc[9804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:33.019225 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:32861
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:32861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:33.372030 9817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:33.372352 9817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:33.372450 9817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:33.379860 9817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:33.379981 9817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:33.380028 9817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:33.380100 9817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:33.380146 9817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:33.390305 9817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:32861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:32861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:33.391764 9817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:33.393194 9817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:33.406390 9824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:33.406442 9826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:33.406481 9823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:33.407436 9817 server_base.cc:1034] running on GCE node
I20260811 01:43:33.408229 9817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:33.409744 9817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:33.411017 9817 hybrid_clock.cc:648] HybridClock initialized: now 1786412613410975 us; error 39 us; skew 500 ppm
I20260811 01:43:33.411396 9817 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:33 dist-test-slave-0kls krb5kdc[9804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412613, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:33.424232 9817 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:33.426170 9817 webserver.cc:460] Webserver started at http://127.17.132.62:37869/ using document root <none> and password file <none>
I20260811 01:43:33.426961 9817 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:33.427143 9817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:33.427505 9817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:33.430981 9817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "a571ee86405541de85945c0ed5a7d952"
format_stamp: "Formatted at 2026-08-11 01:43:33 on dist-test-slave-0kls"
server_key: "133414a20d419925a1bcddd512b5259f"
server_key_iv: "208c2613ded02b63a0d87926a1306ccb"
server_key_version: "encryptionkey@0"
I20260811 01:43:33.431865 9817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "a571ee86405541de85945c0ed5a7d952"
format_stamp: "Formatted at 2026-08-11 01:43:33 on dist-test-slave-0kls"
server_key: "133414a20d419925a1bcddd512b5259f"
server_key_iv: "208c2613ded02b63a0d87926a1306ccb"
server_key_version: "encryptionkey@0"
I20260811 01:43:33.437664 9817 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260811 01:43:33.441543 9833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:33.442970 9817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:33.443200 9817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "a571ee86405541de85945c0ed5a7d952"
format_stamp: "Formatted at 2026-08-11 01:43:33 on dist-test-slave-0kls"
server_key: "133414a20d419925a1bcddd512b5259f"
server_key_iv: "208c2613ded02b63a0d87926a1306ccb"
server_key_version: "encryptionkey@0"
I20260811 01:43:33.443420 9817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:33.469087 9817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:33.473453 9817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:33.473829 9817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:33.493538 9817 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:32861
I20260811 01:43:33.493571 9886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:32861 every 8 connection(s)
I20260811 01:43:33.495124 9817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:33.499024 9887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:33.503993 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9817
I20260811 01:43:33.504211 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:33.504645 17936 external_mini_cluster.cc:1428] Setting key 391e3e88276bb30f8b96f7ff389f0fb5
I20260811 01:43:33.511022 9887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952: Bootstrap starting.
I20260811 01:43:33.514869 9887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:33.516317 9887 log.cc:824] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:33.519769 9890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:33.506606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46487 (local address 127.17.132.62:32861)
0811 01:43:33.507456 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:33.507467 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:33.507512 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:43:33.509352 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:33.509379 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:33.509884 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:33.510234 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:33.510951 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:33.512361 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:33.514346 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:33.515108 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:33.515260 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:33.516728 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:33.516738 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:33.516754 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:33.517743 (+ 989us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:33.517878 (+ 135us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:33.517918 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:33.518064 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:33.518299 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 01:43:33.518658 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":409,"threads_started":1}
I20260811 01:43:33.519791 9887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952: No bootstrap required, opened a new log
I20260811 01:43:33.523828 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:33.528517 9887 raft_consensus.cc:348] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } }
I20260811 01:43:33.528985 9887 raft_consensus.cc:374] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:33.529125 9887 raft_consensus.cc:729] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a571ee86405541de85945c0ed5a7d952, State: Initialized, Role: FOLLOWER
I20260811 01:43:33.529887 9887 consensus_queue.cc:260] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } }
I20260811 01:43:33.530133 9887 raft_consensus.cc:388] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:33.530292 9887 raft_consensus.cc:482] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:33.530508 9887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:33.533334 9887 raft_consensus.cc:504] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } }
I20260811 01:43:33.533981 9887 leader_election.cc:302] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a571ee86405541de85945c0ed5a7d952; no voters:
I20260811 01:43:33.534699 9887 leader_election.cc:288] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:33.534857 9897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:33.536031 9890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:33.528390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37171 (local address 127.17.132.62:32861)
0811 01:43:33.528601 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:33.528608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:33.529051 (+ 443us) server_negotiation.cc:407] Connection header received
0811 01:43:33.529282 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:33.529288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:33.529372 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:33.529486 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:33.530275 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:33.531369 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:33.532706 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:33.533450 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:33.533580 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:33.534869 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:33.534875 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:33.534879 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:33.534901 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:33.534949 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:33.534971 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:33.535081 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:33.535610 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 01:43:33.535705 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:43:33.536607 9897 raft_consensus.cc:686] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [term 1 LEADER]: Becoming Leader. State: Replica: a571ee86405541de85945c0ed5a7d952, State: Running, Role: LEADER
I20260811 01:43:33.537238 9887 sys_catalog.cc:564] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:33.537235 9897 consensus_queue.cc:237] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } }
I20260811 01:43:33.541080 9899 sys_catalog.cc:455] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a571ee86405541de85945c0ed5a7d952. Latest consensus state: current_term: 1 leader_uuid: "a571ee86405541de85945c0ed5a7d952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } } }
I20260811 01:43:33.541138 9898 sys_catalog.cc:455] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a571ee86405541de85945c0ed5a7d952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a571ee86405541de85945c0ed5a7d952" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 32861 } } }
I20260811 01:43:33.541563 9899 sys_catalog.cc:458] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:33.541576 9898 sys_catalog.cc:458] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952 [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:33.546836 9907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:33.551520 9907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:33.560606 9907 catalog_manager.cc:1347] Generated new cluster ID: a2d1d335fc664f4ba3e57beb8d4bf679
I20260811 01:43:33.560745 9907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:33.570479 9907 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:33.572512 9907 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:33.587978 9907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a571ee86405541de85945c0ed5a7d952: Generated new TSK 0
I20260811 01:43:33.589145 9907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:33.602279 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9817
W20260811 01:43:33.603813 9882 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46487
W20260811 01:43:33.604550 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9817: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:33.604694 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9817
2026-08-11T01:43:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2128 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:33 dist-test-slave-0kls krb5kdc[9918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:33 dist-test-slave-0kls krb5kdc[9918](info): set up 2 sockets
Aug 11 01:43:33 dist-test-slave-0kls krb5kdc[9918](info): commencing operation
krb5kdc: starting...
W20260811 01:43:34.806754 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:35 dist-test-slave-0kls krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:35.165912 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:41065
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:41065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:35.525486 9931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:35.525861 9931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:35.526033 9931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:35.533483 9931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:35.533617 9931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:35.533725 9931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:35.533878 9931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:35.533953 9931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:35.544027 9931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:41065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:41065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:35.545480 9931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:35.546969 9931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:35.559455 9936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:35.559525 9939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:35.559495 9937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:35.560948 9931 server_base.cc:1034] running on GCE node
I20260811 01:43:35.561756 9931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:35.563300 9931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:35.564515 9931 hybrid_clock.cc:648] HybridClock initialized: now 1786412615564479 us; error 29 us; skew 500 ppm
I20260811 01:43:35.564914 9931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:35 dist-test-slave-0kls krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412615, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:35.568214 9931 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:35.569936 9931 webserver.cc:460] Webserver started at http://127.17.132.62:34263/ using document root <none> and password file <none>
I20260811 01:43:35.570695 9931 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:35.570858 9931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:35.571200 9931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:35.574460 9931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "9262baeeeedb4c65988bd7e2ee96951c"
format_stamp: "Formatted at 2026-08-11 01:43:35 on dist-test-slave-0kls"
server_key: "33cd441aded6a7f8e890d26e40f325f5"
server_key_iv: "b127790e027b87697b18379b74f0c33f"
server_key_version: "encryptionkey@0"
I20260811 01:43:35.575312 9931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "9262baeeeedb4c65988bd7e2ee96951c"
format_stamp: "Formatted at 2026-08-11 01:43:35 on dist-test-slave-0kls"
server_key: "33cd441aded6a7f8e890d26e40f325f5"
server_key_iv: "b127790e027b87697b18379b74f0c33f"
server_key_version: "encryptionkey@0"
I20260811 01:43:35.580909 9931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:43:35.584878 9947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:35.586417 9931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:35.586625 9931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "9262baeeeedb4c65988bd7e2ee96951c"
format_stamp: "Formatted at 2026-08-11 01:43:35 on dist-test-slave-0kls"
server_key: "33cd441aded6a7f8e890d26e40f325f5"
server_key_iv: "b127790e027b87697b18379b74f0c33f"
server_key_version: "encryptionkey@0"
I20260811 01:43:35.586855 9931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:35.593585 9931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:35.598258 9931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:35.598604 9931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:35.619055 9931 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:41065
I20260811 01:43:35.619148 10001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:41065 every 8 connection(s)
I20260811 01:43:35.620528 9931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:35.621752 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 9931
I20260811 01:43:35.622005 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:35.622462 17936 external_mini_cluster.cc:1428] Setting key 19e76e30f4fc8dd2c2baf8446ad90fdf
I20260811 01:43:35.625003 10002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:35.630393 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:35.624227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34977 (local address 127.17.132.62:41065)
0811 01:43:35.625036 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:35.625048 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:35.625088 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:43:35.626807 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:35.626829 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:35.627139 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:35.627488 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:35.628591 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:35.628601 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:35.628622 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:35.628644 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:35.628795 (+ 151us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:35.628825 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:35.629015 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:35.629136 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 01:43:35.629363 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":374,"threads_started":1}
I20260811 01:43:35.634402 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:35.637553 10002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c: Bootstrap starting.
I20260811 01:43:35.641150 10002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:35.641445 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:35.638740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41473 (local address 127.17.132.62:41065)
0811 01:43:35.638897 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:35.638901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:35.639411 (+ 510us) server_negotiation.cc:407] Connection header received
0811 01:43:35.639614 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:35.639619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:35.639677 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:35.639814 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:35.640759 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:35.640764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:35.640769 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:43:35.640787 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:35.640834 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:43:35.640848 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:35.640966 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:35.641107 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:43:35.641173 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 01:43:35.642478 10002 log.cc:824] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:35.645275 10002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c: No bootstrap required, opened a new log
I20260811 01:43:35.652786 10002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } }
I20260811 01:43:35.653220 10002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:43:35.653337 10002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9262baeeeedb4c65988bd7e2ee96951c, State: Initialized, Role: FOLLOWER
I20260811 01:43:35.654052 10002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } }
I20260811 01:43:35.654306 10002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:43:35.654466 10002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:43:35.654664 10002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:35.656901 10002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } }
I20260811 01:43:35.657430 10002 leader_election.cc:302] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9262baeeeedb4c65988bd7e2ee96951c; no voters:
I20260811 01:43:35.658161 10002 leader_election.cc:288] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:43:35.658301 10012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:35.659050 10012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [term 1 LEADER]: Becoming Leader. State: Replica: 9262baeeeedb4c65988bd7e2ee96951c, State: Running, Role: LEADER
I20260811 01:43:35.659672 10012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } }
I20260811 01:43:35.660358 10002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:35.662487 10015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9262baeeeedb4c65988bd7e2ee96951c. Latest consensus state: current_term: 1 leader_uuid: "9262baeeeedb4c65988bd7e2ee96951c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } } }
I20260811 01:43:35.662945 10015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:35.663539 10013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9262baeeeedb4c65988bd7e2ee96951c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9262baeeeedb4c65988bd7e2ee96951c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 41065 } } }
I20260811 01:43:35.663947 10013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:35.664026 10020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:35.672482 10020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:43:35.681915 10020 catalog_manager.cc:1347] Generated new cluster ID: c63c93ccd44a4b16bf40b9b71415e959
I20260811 01:43:35.682050 10020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:35.697243 10020 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:35.697726 10020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:35.710623 10020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9262baeeeedb4c65988bd7e2ee96951c: Generated new TSK 0
I20260811 01:43:35.711514 10020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:43:35.723929 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9931
W20260811 01:43:35.725237 9996 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34977
W20260811 01:43:35.725999 17936 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 9931: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:43:35.726166 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 9931
2026-08-11T01:43:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2120 ms)
[----------] 18 tests from AuthTokenIssuingTest (39068 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:35 dist-test-slave-0kls krb5kdc[10036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:35 dist-test-slave-0kls krb5kdc[10036](info): set up 2 sockets
Aug 11 01:43:35 dist-test-slave-0kls krb5kdc[10036](info): commencing operation
krb5kdc: starting...
W20260811 01:43:36.958968 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:37 dist-test-slave-0kls krb5kdc[10036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:37.325167 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43421
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:37.691476 10050 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:37.691833 10050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:37.691915 10050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:37.691998 10050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:37.699347 10050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:37.699443 10050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:37.699504 10050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:37.699551 10050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:37.699617 10050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:37.709837 10050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:43421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:37.711288 10050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:37.712604 10050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:37.724728 10056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:37.724771 10057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:37.725087 10059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:37.725891 10050 server_base.cc:1034] running on GCE node
I20260811 01:43:37.726698 10050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:37.728163 10050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:37.729403 10050 hybrid_clock.cc:648] HybridClock initialized: now 1786412617729343 us; error 29 us; skew 500 ppm
I20260811 01:43:37.729758 10050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:37 dist-test-slave-0kls krb5kdc[10036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:37.733104 10050 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:37.734752 10050 webserver.cc:460] Webserver started at http://127.17.132.62:42499/ using document root <none> and password file <none>
I20260811 01:43:37.735464 10050 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:37.735590 10050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:37.735950 10050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:37.739076 10050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "c5a977e5f8194309a6926dfc6c52027a"
format_stamp: "Formatted at 2026-08-11 01:43:37 on dist-test-slave-0kls"
server_key: "a26ee1007079bb13f6f031074487d99a"
server_key_iv: "3d0236ae5741244b106c2eadcd98cbc1"
server_key_version: "encryptionkey@0"
I20260811 01:43:37.739929 10050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "c5a977e5f8194309a6926dfc6c52027a"
format_stamp: "Formatted at 2026-08-11 01:43:37 on dist-test-slave-0kls"
server_key: "a26ee1007079bb13f6f031074487d99a"
server_key_iv: "3d0236ae5741244b106c2eadcd98cbc1"
server_key_version: "encryptionkey@0"
I20260811 01:43:37.745503 10050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:43:37.749188 10066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:37.750628 10050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:37.750819 10050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "c5a977e5f8194309a6926dfc6c52027a"
format_stamp: "Formatted at 2026-08-11 01:43:37 on dist-test-slave-0kls"
server_key: "a26ee1007079bb13f6f031074487d99a"
server_key_iv: "3d0236ae5741244b106c2eadcd98cbc1"
server_key_version: "encryptionkey@0"
I20260811 01:43:37.751060 10050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:37.796649 10050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:37.801420 10050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:37.801731 10050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:37.822892 10050 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:43421
I20260811 01:43:37.822911 10123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:43421 every 8 connection(s)
I20260811 01:43:37.824446 10050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:37.828760 10124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:37.833468 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10050
I20260811 01:43:37.833719 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:37.834637 17936 external_mini_cluster.cc:1428] Setting key 8844cb2a5a539139dcda1b2d6eadf3b0
I20260811 01:43:37.837272 10124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:37 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:37.862805 10129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.841465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.17.132.62:43421)
0811 01:43:37.843235 (+ 1770us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:37.843244 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:37.843294 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:43:37.844856 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:37.844862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:37.845090 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:37.845303 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:37.846657 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:37.847875 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:37.849602 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:37.850245 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:37.850393 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:37.854710 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:37.854719 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:37.854732 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:37.854795 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:37.858125 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:37.858830 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:37.858840 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:37.858849 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:37.859000 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:37.859409 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:37.859414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:37.859417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:37.859977 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:37.860200 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:37.860770 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 01:43:37.861140 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1542,"thread_start_us":1294,"threads_started":1}
I20260811 01:43:37.862824 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.841465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43421 (local address 127.0.0.1:47464)
0811 01:43:37.842356 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.842417 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:37.844458 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:37.845327 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:37.845334 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:37.846099 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:37.846439 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:37.846456 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:37.848037 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:37.848042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:37.849423 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:37.849442 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:37.850502 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:37.850512 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:37.850751 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:37.851519 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:37.851554 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:37.854451 (+ 2897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:37.858264 (+ 3813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:37.858277 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:37.858291 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:37.858689 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:37.859114 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:37.859121 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:37.859124 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:37.859291 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:37.860146 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:37.860162 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:37.860377 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 01:43:37.860637 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 01:43:37.861260 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":149,"thread_start_us":383,"threads_started":1}
I20260811 01:43:37.866322 10124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:37.867446 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.866974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37600)
0811 01:43:37.867207 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.867322 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 01:43:37.867707 10071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.132.61@KRBTEST.COM; defaulting to no policy
I20260811 01:43:37.869437 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.869023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37608)
0811 01:43:37.869196 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.869267 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:43:37.869813 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:41827: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
I20260811 01:43:37.911396 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:41827
--webserver_interface=127.17.132.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:43:37.919170 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } attempt: 1
I20260811 01:43:37.920428 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.919937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37616)
0811 01:43:37.920143 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.920299 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:43:37.921466 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.921064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37622)
0811 01:43:37.921218 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.921306 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:43:37.921638 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:41827: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
I20260811 01:43:37.989933 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } attempt: 2
I20260811 01:43:37.991313 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.990732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37632)
0811 01:43:37.990947 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.991079 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:43:37.992408 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:37.992020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37646)
0811 01:43:37.992178 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:37.992265 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 01:43:37.992794 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:41827: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
I20260811 01:43:38.084117 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } attempt: 3
I20260811 01:43:38.085531 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.085005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37660)
0811 01:43:38.085272 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.085376 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 01:43:38.086773 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.086351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37664)
0811 01:43:38.086533 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.086617 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 01:43:38.086988 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:41827: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
I20260811 01:43:38.230260 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } attempt: 4
I20260811 01:43:38.231767 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.231138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37678)
0811 01:43:38.231525 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.231621 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216}
I20260811 01:43:38.232946 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.232543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37694)
0811 01:43:38.232705 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.232806 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 01:43:38.233145 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:41827: Network error: Client connection negotiation failed: client connection to 127.17.132.61:41827: connect: Connection refused (error 111)
W20260811 01:43:38.306553 10133 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:38.306994 10133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:38.307121 10133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:38.307256 10133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:38.315418 10133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:38.315673 10133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:38.315835 10133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:38.315932 10133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:38.316043 10133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:38.327631 10133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:41827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.132.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:38.329180 10133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:38.330787 10133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:38.344496 10138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:38.344444 10139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:38.344348 10143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:38.345175 10133 server_base.cc:1034] running on GCE node
I20260811 01:43:38.346493 10133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:38.348549 10133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:38.349956 10133 hybrid_clock.cc:648] HybridClock initialized: now 1786412618349887 us; error 42 us; skew 500 ppm
I20260811 01:43:38.350433 10133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:38.354200 10133 init.cc:377] Logged in from keytab as kudu/127.17.132.61@KRBTEST.COM (short username kudu)
I20260811 01:43:38.356003 10133 webserver.cc:460] Webserver started at http://127.17.132.61:44345/ using document root <none> and password file <none>
I20260811 01:43:38.356827 10133 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:38.356923 10133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:38.357299 10133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:38.360634 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data/instance:
uuid: "1429fe2ca6df4ebaad39b8c29dc04f89"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "a4b23747fab56764812eaeee491b3003"
server_key_iv: "d9d6c8aea99278790ea96d698eba9600"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.361521 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal/instance:
uuid: "1429fe2ca6df4ebaad39b8c29dc04f89"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "a4b23747fab56764812eaeee491b3003"
server_key_iv: "d9d6c8aea99278790ea96d698eba9600"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.368072 10133 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:43:38.372167 10150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:38.373723 10133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:43:38.374034 10133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "1429fe2ca6df4ebaad39b8c29dc04f89"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "a4b23747fab56764812eaeee491b3003"
server_key_iv: "d9d6c8aea99278790ea96d698eba9600"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.374285 10133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:38.386498 10133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:38.391253 10133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:38.391562 10133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:38.412617 10133 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.61:41827
I20260811 01:43:38.412645 10209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.61:41827 every 8 connection(s)
I20260811 01:43:38.414214 10133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
I20260811 01:43:38.417747 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10133
I20260811 01:43:38.417995 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-1/wal/instance
I20260811 01:43:38.418473 17936 external_mini_cluster.cc:1428] Setting key 8e981d6dd09f4d4eab0484c463311a29
I20260811 01:43:38.418706 10210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:38.425836 10210 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.60@KRBTEST.COM" created.
I20260811 01:43:38.458218 10213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.428688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47472 (local address 127.17.132.62:43421)
0811 01:43:38.429262 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:38.429271 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:38.430418 (+ 1147us) server_negotiation.cc:407] Connection header received
0811 01:43:38.432396 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:38.432403 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:38.432500 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:38.432646 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:38.434776 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.435499 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.438423 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.438911 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.439017 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.449848 (+ 10831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:38.449864 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:38.449868 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:38.449933 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:38.453378 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.454676 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.454683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.454685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.454888 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.455690 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.455697 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.455704 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.456219 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:38.456420 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:38.457521 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0811 01:43:38.457752 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":263,"threads_started":1}
I20260811 01:43:38.459699 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.429274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43421 (local address 127.0.0.1:47472)
0811 01:43:38.430216 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.430275 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:38.432089 (+ 1814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:38.432869 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:38.432877 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:38.433670 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:38.434513 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.434541 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.435689 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.435697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.438217 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.438239 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.439211 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.439224 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.439606 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.445734 (+ 6128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:38.445813 (+ 79us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:38.449370 (+ 3557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:38.453636 (+ 4266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.453650 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.453681 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.454487 (+ 806us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.455059 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.455066 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.455070 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.455490 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.456416 (+ 926us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:38.456428 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:38.456988 (+ 560us) client_negotiation.cc:769] Sending connection context
0811 01:43:38.457364 (+ 376us) client_negotiation.cc:240] Negotiation successful
0811 01:43:38.458061 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":457,"threads_started":1}
I20260811 01:43:38.461894 10210 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:38.480786 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.462643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37708)
0811 01:43:38.462900 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.462922 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:38.463065 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:38.464334 (+ 1269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:38.464341 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:38.464884 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:38.465108 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.465124 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.466711 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.466719 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.468231 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.468249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.469457 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.469466 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.469681 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.470397 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:38.470424 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:38.472986 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:38.477948 (+ 4962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.477952 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.477955 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.478415 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.478943 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.478946 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.478948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.479097 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.479993 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:38.480000 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:38.480143 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 01:43:38.480264 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 01:43:38.480494 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:43:38.481364 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.463020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37708 (local address 127.17.132.61:41827)
0811 01:43:38.463859 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:38.463865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:38.463891 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:43:38.463939 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:38.463944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:38.464142 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:38.464270 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:38.465323 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.466560 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.468391 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.469289 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.469419 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.473242 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:38.473262 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:38.473285 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:38.473332 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:38.477684 (+ 4352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.478581 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.478594 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.478599 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.478817 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.479207 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.479214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.479220 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.479721 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:38.479986 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:38.480527 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 01:43:38.480844 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":467,"threads_started":1}
I20260811 01:43:38.483932 10210 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:38.485332 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.484722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33616)
0811 01:43:38.484960 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.485121 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 01:43:38.485664 10153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.487527 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.487032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33632)
0811 01:43:38.487241 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.487371 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 01:43:38.487805 10210 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
I20260811 01:43:38.501151 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:44061
--webserver_interface=127.17.132.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:44629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:43:38.532410 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } attempt: 5
I20260811 01:43:38.537173 10210 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 1
I20260811 01:43:38.538491 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.537949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33646)
0811 01:43:38.538248 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.538342 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260811 01:43:38.539511 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.539142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33660)
0811 01:43:38.539314 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.539402 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:43:38.539819 10210 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:38.548544 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.533336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37720)
0811 01:43:38.533567 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.533590 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:38.533775 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:38.534214 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:38.534219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:38.534676 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:38.534865 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.534874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.536015 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.536021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.536909 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:38.536921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.538110 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.538118 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:38.538380 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.539088 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:38.539113 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:38.541620 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:38.545934 (+ 4314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.545939 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.545942 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.546404 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.546851 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:38.546855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:38.546857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:38.546995 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:38.547657 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:38.547660 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:38.547818 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 01:43:38.547978 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 01:43:38.548298 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 01:43:38.548679 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.533373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.17.132.61:41827)
0811 01:43:38.533591 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:38.533597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:38.533689 (+ 92us) server_negotiation.cc:407] Connection header received
0811 01:43:38.533967 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:38.533979 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:38.534063 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:38.534176 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:38.535022 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.535812 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.537076 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.537934 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.538060 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:38.541879 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:38.541887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:38.541893 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:38.541939 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:38.545694 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.546551 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.546559 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.546562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.546730 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:38.547103 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:38.547107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:38.547110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:38.547523 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:38.547696 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:38.548129 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 01:43:38.548380 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260811 01:43:38.549954 10124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:38.551142 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.550641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33672)
0811 01:43:38.550821 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.550929 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 01:43:38.552153 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.551787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33680)
0811 01:43:38.551951 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.552045 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:43:38.552385 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.603756 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 1
I20260811 01:43:38.605001 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.604514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33696)
0811 01:43:38.604720 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.604826 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:43:38.606220 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.605878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33708)
0811 01:43:38.606033 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.606108 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 01:43:38.606473 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.608057 10210 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 2
I20260811 01:43:38.609010 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.608604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33722)
0811 01:43:38.608786 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.608870 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 01:43:38.610119 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.609756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33728)
0811 01:43:38.609922 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.609999 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 01:43:38.610394 10210 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.674731 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 2
I20260811 01:43:38.676029 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.675517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33738)
0811 01:43:38.675749 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.675850 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 01:43:38.677121 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.676782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33752)
0811 01:43:38.676939 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.677011 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:43:38.677340 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.701609 10210 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 3
I20260811 01:43:38.702844 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.702361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33758)
0811 01:43:38.702586 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.702682 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:43:38.704067 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.703634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33764)
0811 01:43:38.703874 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.703952 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260811 01:43:38.704361 10210 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.783574 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 3
I20260811 01:43:38.784704 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.784238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33766)
0811 01:43:38.784441 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.784536 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 01:43:38.785910 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.785473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33780)
0811 01:43:38.785678 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.785749 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 01:43:38.786106 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.847625 10210 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 4
I20260811 01:43:38.848975 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.848468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33792)
0811 01:43:38.848710 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.848809 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 01:43:38.850023 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.849661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33794)
0811 01:43:38.849844 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.849917 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:43:38.850275 10210 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
W20260811 01:43:38.873293 10219 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:38.873677 10219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:38.873826 10219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:38.873991 10219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:38.881903 10219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:38.882009 10219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:38.882068 10219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:38.882146 10219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:38.882262 10219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:38.893256 10219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:44629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:43421,127.17.132.61:41827,127.17.132.60:44061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:44061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.132.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:38.894979 10219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:38.896473 10219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:38.908998 10224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:38.909056 10225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:38.908963 10227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:38.910133 10219 server_base.cc:1034] running on GCE node
I20260811 01:43:38.910948 10219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:38.912467 10219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:38.913719 10219 hybrid_clock.cc:648] HybridClock initialized: now 1786412618913646 us; error 50 us; skew 500 ppm
I20260811 01:43:38.914096 10219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:38.917474 10219 init.cc:377] Logged in from keytab as kudu/127.17.132.60@KRBTEST.COM (short username kudu)
I20260811 01:43:38.919215 10219 webserver.cc:460] Webserver started at http://127.17.132.60:34659/ using document root <none> and password file <none>
I20260811 01:43:38.920001 10219 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:38.920153 10219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:38.920523 10219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:38.923866 10219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data/instance:
uuid: "8fab3332edcd4d1c96df662f6dd41fc6"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "6f22d681f2e78af0ef3af60291a0c5b1"
server_key_iv: "cda22667acbcefffaa6227d473efce4b"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.924751 10219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal/instance:
uuid: "8fab3332edcd4d1c96df662f6dd41fc6"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "6f22d681f2e78af0ef3af60291a0c5b1"
server_key_iv: "cda22667acbcefffaa6227d473efce4b"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.930509 10219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:43:38.934358 10234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:38.935902 10219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:43:38.936098 10219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "8fab3332edcd4d1c96df662f6dd41fc6"
format_stamp: "Formatted at 2026-08-11 01:43:38 on dist-test-slave-0kls"
server_key: "6f22d681f2e78af0ef3af60291a0c5b1"
server_key_iv: "cda22667acbcefffaa6227d473efce4b"
server_key_version: "encryptionkey@0"
I20260811 01:43:38.936352 10219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:38.960078 10219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:38.963331 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 4
I20260811 01:43:38.964439 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.963930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33802)
0811 01:43:38.964150 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.964259 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:43:38.964569 10219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:38.964877 10219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:38.965557 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.965149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33806)
0811 01:43:38.965316 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:38.965406 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 01:43:38.965826 10124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:44061: Network error: Client connection negotiation failed: client connection to 127.17.132.60:44061: connect: Connection refused (error 111)
I20260811 01:43:38.984763 10219 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.60:44061
I20260811 01:43:38.984800 10290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.60:44061 every 8 connection(s)
I20260811 01:43:38.986279 10219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
I20260811 01:43:38.986644 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10219
I20260811 01:43:38.986846 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786412236095684-17936-0/minicluster-data/master-2/wal/instance
I20260811 01:43:38.987385 17936 external_mini_cluster.cc:1428] Setting key 4508fcabd8cda0dac510dc28bb8aef9b
I20260811 01:43:38.990885 10291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:38.998047 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:38 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:39.011171 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:38.989446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33816 (local address 127.17.132.60:44061)
0811 01:43:38.990314 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:38.990327 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:38.990368 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:43:38.992066 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:38.992088 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:38.992452 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:38.992837 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:38.994532 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.995914 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.997275 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:38.997987 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:38.998204 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.002858 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.002866 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.002876 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.002916 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.006445 (+ 3529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.007239 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.007245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.007252 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.007424 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.007915 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.007919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.007921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.008502 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.008734 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.009358 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.009845 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":420,"threads_started":1}
I20260811 01:43:39.017071 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.000714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47476 (local address 127.17.132.62:43421)
0811 01:43:39.002085 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.002090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.002113 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:43:39.002165 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.002168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.002237 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.002363 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.003755 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.004927 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.006468 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.006949 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.007059 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.010760 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.010765 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.010769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.010811 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.014014 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.014960 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.014965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.014969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.015156 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.015571 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.015580 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.015583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.015839 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.015950 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.016515 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.016673 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1270,"thread_start_us":1154,"threads_started":1}
I20260811 01:43:39.017109 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.000606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:43421 (local address 127.0.0.1:47476)
0811 01:43:39.001377 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:39.001428 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:39.001580 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:39.002437 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:39.002445 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:39.003149 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:39.003514 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.003530 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.005113 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.005118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.006301 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.006315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.007167 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.007175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.007338 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.007949 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:39.007969 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:39.010566 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:39.014224 (+ 3658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.014235 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.014243 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.014860 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.015271 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.015274 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.015277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.015444 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.015976 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:39.015984 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:39.016212 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 01:43:39.016431 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 01:43:39.016761 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":359,"threads_started":1}
I20260811 01:43:39.018536 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:39.031670 10297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.014445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47484 (local address 127.17.132.62:43421)
0811 01:43:39.015136 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.015141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.015164 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:43:39.015210 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.015216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.015305 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.015392 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.016944 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.018266 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.019939 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.020376 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.020516 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.025341 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.025350 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.025358 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.025406 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.028848 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.029522 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.029528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.029532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.029695 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.030128 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.030136 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.030140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.030426 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.030720 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.031054 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.031296 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":314,"threads_started":1}
I20260811 01:43:39.032776 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.019194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:41827 (local address 127.0.0.1:37728)
0811 01:43:39.019421 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:39.019440 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:39.019532 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:39.019841 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:39.019848 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:39.020208 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:39.020346 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.020354 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.021353 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.021361 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.022919 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.022937 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.023688 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.023697 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.023881 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.024491 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:39.024507 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:39.026599 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:39.030177 (+ 3578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.030180 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.030183 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.030563 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.030984 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.030989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.030999 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.031147 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.031780 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:39.031785 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:39.031943 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 01:43:39.032115 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 01:43:39.032416 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260811 01:43:39.032821 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.019308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37728 (local address 127.17.132.61:41827)
0811 01:43:39.019466 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.019471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.019486 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:43:39.019639 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.019642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.019702 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.019791 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.020500 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.021208 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.023094 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.023521 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.023618 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.026810 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.026818 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.026825 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.026873 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.030029 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.030694 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.030700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.030704 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.030865 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.031268 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.031274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.031279 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.031646 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.031815 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.032210 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.032428 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 01:43:39.033849 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:39.048930 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.034781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33828)
0811 01:43:39.035013 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:39.035027 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:39.035114 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:39.035422 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:39.035425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:39.035935 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:39.036144 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.036157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.037287 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.037290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.038335 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.038351 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.039183 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.039187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.039400 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.039975 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:39.040039 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:39.042579 (+ 2540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:39.046393 (+ 3814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.046397 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.046399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.046770 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.047192 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.047199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.047205 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.047357 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.047974 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:39.047980 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:39.048146 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 01:43:39.048321 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 01:43:39.048580 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260811 01:43:39.049438 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.034781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.17.132.60:44061)
0811 01:43:39.034973 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.034980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.035093 (+ 113us) server_negotiation.cc:407] Connection header received
0811 01:43:39.035203 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.035208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.035280 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.035396 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.036289 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.037161 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.038481 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.039000 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.039124 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.042780 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.042785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.042788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.042818 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.046247 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.046890 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.046895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.046898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.047056 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.047466 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.047470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.047471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.047833 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.047989 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.048435 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.048840 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":64}
I20260811 01:43:39.050547 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.033428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37730 (local address 127.17.132.61:41827)
0811 01:43:39.033641 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.033647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.033663 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:43:39.033837 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.033842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.033915 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.034013 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.035532 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.036574 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.038072 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.038670 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.038760 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.043559 (+ 4799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.043567 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.043572 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.043620 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.046899 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.047717 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.047722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.047725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.047891 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.048346 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.048351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.048354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.048737 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.049020 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.049931 (+ 911us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.050207 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 01:43:39.055330 10291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: Bootstrap starting.
I20260811 01:43:39.055716 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:43:39.059008 10291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:39.060475 10291 log.cc:824] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:39.058467 10095 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c5a977e5f8194309a6926dfc6c52027a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47484
I20260811 01:43:39.063688 10291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: No bootstrap required, opened a new log
I20260811 01:43:39.074579 10291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.075013 10291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fab3332edcd4d1c96df662f6dd41fc6, State: Initialized, Role: FOLLOWER
I20260811 01:43:39.075528 10291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.076498 10299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.076875 10299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.077818 10291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:43:39.087320 10311 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:43:39.087502 10311 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:43:39.085819 10219 master_runner.cc:186] Error getting master registration for 127.17.132.62:43421: OK, instance_id { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" instance_seqno: 1786412617816313 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:43:39.097707 10219 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:43:39.149537 10210 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 5
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412618, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:43:39.165808 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.150466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.17.132.60:44061)
0811 01:43:39.150724 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.150732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.150760 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:43:39.151000 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.151005 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.151087 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.151208 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.152048 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.152817 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.154733 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.155337 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.155486 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.159555 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.159561 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.159565 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.159610 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.162691 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.163504 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.163508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.163511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.163675 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.164101 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.164106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.164111 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.164508 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.164709 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.165103 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.165355 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:43:39.165769 10214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.150392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33840)
0811 01:43:39.150689 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:39.150709 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:39.150851 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:39.151253 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:39.151260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:39.151702 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:39.151871 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.151887 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.152968 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.152974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.154567 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.154585 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.155503 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.155509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.155753 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.156517 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:39.156536 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:39.159270 (+ 2734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:39.162876 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.162883 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.162887 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.163343 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.163807 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.163813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.163817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.163981 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.164638 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:39.164643 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:39.164826 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 01:43:39.164988 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 01:43:39.165354 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170}
I20260811 01:43:39.171156 10210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: Bootstrap starting.
I20260811 01:43:39.175674 10210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:39.177102 10210 log.cc:824] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:39.180999 10210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: No bootstrap required, opened a new log
I20260811 01:43:39.192901 10210 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.193397 10210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1429fe2ca6df4ebaad39b8c29dc04f89, State: Initialized, Role: FOLLOWER
I20260811 01:43:39.194037 10210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.195261 10314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.195757 10314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.196648 10210 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:43:39.207429 10326 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:43:39.207571 10326 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:43:39.204502 10133 master_runner.cc:186] Error getting master registration for 127.17.132.62:43421: OK, instance_id { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" instance_seqno: 1786412617816313 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:43:39.216404 10133 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:43:39.217401 10241 tablet.cc:2369] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:43:39.243065 10124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } attempt: 5
Aug 11 01:43:39 dist-test-slave-0kls krb5kdc[10036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412617, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:43:39.259811 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.243841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:44061 (local address 127.0.0.1:33846)
0811 01:43:39.244190 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:39.244212 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:39.244345 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:39.244765 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:39.244770 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:39.245201 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:39.245388 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.245398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.246916 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.246924 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.247911 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:39.247925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.249231 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.249237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:39.249483 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.250223 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:39.250253 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:39.253258 (+ 3005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:39.256915 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.256922 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.256928 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.257477 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.257955 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:39.257960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:39.257963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:39.258126 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:39.258761 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:39.258766 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:39.258922 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 01:43:39.259063 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 01:43:39.259371 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183}
I20260811 01:43:39.259811 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.244067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33846 (local address 127.17.132.60:44061)
0811 01:43:39.244252 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.244260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.244283 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:43:39.244508 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.244515 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.244616 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.244716 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.245580 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.246776 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.248090 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.248838 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.248964 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.253483 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.253488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.253491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.253528 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.256768 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.257633 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.257639 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.257646 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.257841 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.258249 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.258256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.258260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.258632 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.258773 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.259171 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.259417 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:43:39.266397 10124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: Bootstrap starting.
I20260811 01:43:39.270713 10124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:39.272234 10124 log.cc:824] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:39.276389 10124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: No bootstrap required, opened a new log
I20260811 01:43:39.284757 10124 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.285203 10124 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a977e5f8194309a6926dfc6c52027a, State: Initialized, Role: FOLLOWER
I20260811 01:43:39.285750 10124 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.287150 10329 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.287906 10329 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.288504 10124 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:39.288585 10095 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:43:39.288784 10095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:39.293143 10095 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.296708 10181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5a977e5f8194309a6926dfc6c52027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89"
I20260811 01:43:39.297372 10181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:39.302752 10181 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a977e5f8194309a6926dfc6c52027a in term 1.
I20260811 01:43:39.303691 10071 leader_election.cc:302] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1429fe2ca6df4ebaad39b8c29dc04f89, c5a977e5f8194309a6926dfc6c52027a; no voters:
W20260811 01:43:39.305191 10073 tablet.cc:2369] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:43:39.307129 10264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5a977e5f8194309a6926dfc6c52027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8fab3332edcd4d1c96df662f6dd41fc6"
I20260811 01:43:39.307819 10264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:39.312665 10264 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a977e5f8194309a6926dfc6c52027a in term 1.
I20260811 01:43:39.313877 10095 leader_election.cc:288] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [CANDIDATE]: Term 1 election: Requested vote from peers 1429fe2ca6df4ebaad39b8c29dc04f89 (127.17.132.61:41827), 8fab3332edcd4d1c96df662f6dd41fc6 (127.17.132.60:44061)
I20260811 01:43:39.321446 10329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:39.331501 10329 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [term 1 LEADER]: Becoming Leader. State: Replica: c5a977e5f8194309a6926dfc6c52027a, State: Running, Role: LEADER
I20260811 01:43:39.332885 10329 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } }
I20260811 01:43:39.349648 10336 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5a977e5f8194309a6926dfc6c52027a. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.350422 10336 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:39.360212 10346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:39.363443 10348 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:43:39.384284 10346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 01:43:39.394554 10157 tablet.cc:2369] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:43:39.400833 10297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.357171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47496 (local address 127.17.132.62:43421)
0811 01:43:39.357376 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.357383 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.365070 (+ 7687us) server_negotiation.cc:407] Connection header received
0811 01:43:39.365400 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.365406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.365486 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.365569 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.377234 (+ 11665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.378446 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.385735 (+ 7289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.386469 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.386581 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.390923 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.390930 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.390935 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.390987 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.394898 (+ 3911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.396127 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.396134 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.396138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.396319 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.397402 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.397408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.397412 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.397867 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.398132 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.400074 (+ 1942us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.400371 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:43:39.417119 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.356802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.17.132.60:44061)
0811 01:43:39.357051 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.357062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.375677 (+ 18615us) server_negotiation.cc:407] Connection header received
0811 01:43:39.375874 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.375881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.375984 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.376088 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.379639 (+ 3551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.380743 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.384606 (+ 3863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.385359 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.385478 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.403946 (+ 18468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.403954 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.403959 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.404008 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.412976 (+ 8968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.414128 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.414134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.414137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.414306 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.414834 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.414840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.414843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.415343 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.415612 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.416417 (+ 805us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.416696 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:43:39.420858 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:39.376503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.17.132.61:41827)
0811 01:43:39.376693 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.376699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.380259 (+ 3560us) server_negotiation.cc:407] Connection header received
0811 01:43:39.380669 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.380675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.380770 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.380848 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.385918 (+ 5070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.387073 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.389914 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:39.390609 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:39.390711 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:39.402011 (+ 11300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:39.402018 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:39.402023 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:39.402073 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:39.410899 (+ 8826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.411856 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.411861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.411864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.417961 (+ 6097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:39.418420 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:39.418426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:39.418430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:39.418831 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:39.420080 (+ 1249us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:39.420238 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 01:43:39.420489 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:43:39.434366 10264 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [term 1 FOLLOWER]: Refusing update from remote peer c5a977e5f8194309a6926dfc6c52027a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:43:39.434746 10181 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [term 1 FOLLOWER]: Refusing update from remote peer c5a977e5f8194309a6926dfc6c52027a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:43:39.435956 10336 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:43:39.440160 10336 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:43:39.466490 10299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5a977e5f8194309a6926dfc6c52027a. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.466902 10299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.467118 10314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5a977e5f8194309a6926dfc6c52027a. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.467422 10314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.478561 10314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.478929 10314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.479719 10329 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.480115 10329 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:39.483891 10346 catalog_manager.cc:1347] Generated new cluster ID: a2b4e85383c84c72a28f9d8843a71f29
I20260811 01:43:39.484014 10346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:39.490517 10336 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.490850 10336 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:39.496042 10357 mvcc.cc:205] Tried to move back new op lower bound from 7317146089189371904 to 7317146088812818432. Current Snapshot: MvccSnapshot[applied={T|T < 7317146089189371904}]
I20260811 01:43:39.510485 10346 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:39.511870 10299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5a977e5f8194309a6926dfc6c52027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a977e5f8194309a6926dfc6c52027a" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 43421 } } peers { permanent_uuid: "1429fe2ca6df4ebaad39b8c29dc04f89" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 41827 } } peers { permanent_uuid: "8fab3332edcd4d1c96df662f6dd41fc6" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 44061 } } }
I20260811 01:43:39.512166 10299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:39.512573 10346 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:39.544323 10346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5a977e5f8194309a6926dfc6c52027a: Generated new TSK 0
I20260811 01:43:39.546653 10346 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:43:39.691563 10294 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.682067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33858 (local address 127.17.132.60:44061)
0811 01:43:39.682288 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.682295 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.688639 (+ 6344us) server_negotiation.cc:407] Connection header received
0811 01:43:39.689260 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.689266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.689418 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.689533 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.691260 (+ 1727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33858: BlockingRecv error: recv got EOF from 127.0.0.1:33858 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 01:43:39.691586 10297 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.685585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.17.132.62:43421)
0811 01:43:39.685831 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.685839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.689382 (+ 3543us) server_negotiation.cc:407] Connection header received
0811 01:43:39.689654 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.689661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.689767 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.689876 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.691278 (+ 1402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47498: BlockingRecv error: recv got EOF from 127.0.0.1:47498 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 01:43:39.694190 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.688829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37748 (local address 127.17.132.61:41827)
0811 01:43:39.689090 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.689096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.692286 (+ 3190us) server_negotiation.cc:407] Connection header received
0811 01:43:39.692547 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.692554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.692688 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.692779 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.693932 (+ 1153us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37748: BlockingRecv error: recv got EOF from 127.0.0.1:37748 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 01:43:39.703877 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.700720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37752 (local address 127.17.132.61:41827)
0811 01:43:39.700922 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.700929 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.701842 (+ 913us) server_negotiation.cc:407] Connection header received
0811 01:43:39.702092 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.702099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.702233 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.702347 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.703510 (+ 1163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37752: BlockingRecv error: recv got EOF from 127.0.0.1:37752 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 01:43:39.712057 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.709710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.17.132.61:41827)
0811 01:43:39.709921 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.709928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.710488 (+ 560us) server_negotiation.cc:407] Connection header received
0811 01:43:39.710722 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.710728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.710840 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.710946 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.711851 (+ 905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37762: BlockingRecv error: recv got EOF from 127.0.0.1:37762 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 01:43:39.720691 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.718040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37764 (local address 127.17.132.61:41827)
0811 01:43:39.718260 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.718269 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.718900 (+ 631us) server_negotiation.cc:407] Connection header received
0811 01:43:39.719186 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.719192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.719308 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.719417 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.720391 (+ 974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37764: BlockingRecv error: recv got EOF from 127.0.0.1:37764 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 01:43:39.739233 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.736693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37768 (local address 127.17.132.61:41827)
0811 01:43:39.736898 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.736904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.737472 (+ 568us) server_negotiation.cc:407] Connection header received
0811 01:43:39.737706 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.737713 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.737862 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.737989 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.738964 (+ 975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37768: BlockingRecv error: recv got EOF from 127.0.0.1:37768 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 01:43:39.759480 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.756638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37780 (local address 127.17.132.61:41827)
0811 01:43:39.756899 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.756908 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.757601 (+ 693us) server_negotiation.cc:407] Connection header received
0811 01:43:39.757874 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.757881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.758015 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.758148 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.759187 (+ 1039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37780: BlockingRecv error: recv got EOF from 127.0.0.1:37780 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 01:43:39.782789 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.780172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37786 (local address 127.17.132.61:41827)
0811 01:43:39.780397 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.780405 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.781047 (+ 642us) server_negotiation.cc:407] Connection header received
0811 01:43:39.781281 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.781288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.781396 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.781518 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.782489 (+ 971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37786: BlockingRecv error: recv got EOF from 127.0.0.1:37786 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 01:43:39.837185 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.823825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.17.132.61:41827)
0811 01:43:39.824044 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.824056 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.835018 (+ 10962us) server_negotiation.cc:407] Connection header received
0811 01:43:39.835580 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.835587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.835689 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.835773 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.836861 (+ 1088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37800: BlockingRecv error: recv got EOF from 127.0.0.1:37800 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 01:43:39.907846 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:39.905695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37806 (local address 127.17.132.61:41827)
0811 01:43:39.906012 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:39.906019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:39.906391 (+ 372us) server_negotiation.cc:407] Connection header received
0811 01:43:39.906581 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:39.906585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:39.906661 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:39.906765 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:39.907604 (+ 839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37806: BlockingRecv error: recv got EOF from 127.0.0.1:37806 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
W20260811 01:43:40.042315 10216 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:40.040119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37816 (local address 127.17.132.61:41827)
0811 01:43:40.040392 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.040399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.040701 (+ 302us) server_negotiation.cc:407] Connection header received
0811 01:43:40.040944 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.040948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.041023 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.041115 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:40.042028 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37816: BlockingRecv error: recv got EOF from 127.0.0.1:37816 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 01:43:40.089704 10311 catalog_manager.cc:1259] Loaded cluster ID: a2b4e85383c84c72a28f9d8843a71f29
I20260811 01:43:40.089901 10311 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: loading cluster ID for follower catalog manager: success
I20260811 01:43:40.092429 10311 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: acquiring CA information for follower catalog manager: success
I20260811 01:43:40.094203 10311 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8fab3332edcd4d1c96df662f6dd41fc6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:43:40.209908 10326 catalog_manager.cc:1259] Loaded cluster ID: a2b4e85383c84c72a28f9d8843a71f29
I20260811 01:43:40.210058 10326 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: loading cluster ID for follower catalog manager: success
I20260811 01:43:40.212721 10326 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: acquiring CA information for follower catalog manager: success
I20260811 01:43:40.214700 10326 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1429fe2ca6df4ebaad39b8c29dc04f89: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:43:40.309634 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:40.303564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37826 (local address 127.17.132.61:41827)
0811 01:43:40.303815 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.303822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.304041 (+ 219us) server_negotiation.cc:407] Connection header received
0811 01:43:40.304260 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.304264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.304444 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.304570 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:40.305024 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.305892 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.307301 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.307720 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.307829 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:40.308298 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:40.308910 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:40.309106 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:40.309238 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 01:43:40.309331 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:43:40.321616 10430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:40.316085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33870 (local address 127.17.132.60:44061)
0811 01:43:40.316568 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.316573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.316591 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:43:40.316774 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.316778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.316934 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.317123 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:40.317476 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.318244 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.319550 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.319951 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.320041 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:40.320531 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:40.321072 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:40.321191 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:40.321305 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 01:43:40.321375 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":279,"threads_started":1}
I20260811 01:43:40.337081 10430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:40.328877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33874 (local address 127.17.132.60:44061)
0811 01:43:40.329118 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.329127 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.330271 (+ 1144us) server_negotiation.cc:407] Connection header received
0811 01:43:40.330557 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.330563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.330644 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.330759 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:40.331338 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.332482 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.334737 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.335419 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.335556 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:40.336209 (+ 653us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:40.336373 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:40.336442 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:40.336679 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:43:40.336768 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:43:40.337378 10436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:40.328658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47502 (local address 127.17.132.62:43421)
0811 01:43:40.329598 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.329608 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.330447 (+ 839us) server_negotiation.cc:407] Connection header received
0811 01:43:40.330624 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.330633 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.330913 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.331146 (+ 233us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:40.332017 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.333172 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.334861 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.335496 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.335623 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:40.336295 (+ 672us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:40.336646 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:40.336793 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:40.336933 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 01:43:40.337034 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":635,"threads_started":1}
I20260811 01:43:40.338195 10216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:40.330219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37842 (local address 127.17.132.61:41827)
0811 01:43:40.330407 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:40.330413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:40.332070 (+ 1657us) server_negotiation.cc:407] Connection header received
0811 01:43:40.332219 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:40.332224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:40.332313 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:40.332402 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:40.333150 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.334338 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.336095 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:40.336761 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:40.336871 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:40.337359 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:40.337505 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:40.337578 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:40.337830 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 01:43:40.337922 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:43:40.344154 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10050
I20260811 01:43:40.345436 10119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:40.457432 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10050
W20260811 01:43:40.483708 10236 connection.cc:535] server connection from 127.0.0.1:33846 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:43:40.484416 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10133
I20260811 01:43:40.485693 10205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:40.597059 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10133
I20260811 01:43:40.621778 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10219
I20260811 01:43:40.622993 10286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:40.732223 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10219
2026-08-11T01:43:40Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5010 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:43:40 dist-test-slave-0kls krb5kdc[10445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:43:40 dist-test-slave-0kls krb5kdc[10445](info): set up 2 sockets
Aug 11 01:43:40 dist-test-slave-0kls krb5kdc[10445](info): commencing operation
krb5kdc: starting...
W20260811 01:43:41.930912 17936 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/test-user.keytab.
Aug 11 01:43:42 dist-test-slave-0kls krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:43:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:43:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.132.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
Entry for principal kudu/127.17.132.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab.
I20260811 01:43:42.288856 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:38919
--webserver_interface=127.17.132.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:43:42.646979 10459 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:42.647329 10459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:42.647403 10459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:42.647486 10459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:42.655017 10459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:42.655118 10459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:42.655184 10459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:42.655237 10459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:42.655299 10459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:42.665472 10459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.62.keytab
--principal=kudu/127.17.132.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.62:38919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.132.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:42.666867 10459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:42.668179 10459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:42.680338 10468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:42.680398 10466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:42.680420 10465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:42.681686 10459 server_base.cc:1034] running on GCE node
I20260811 01:43:42.682554 10459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:42.684052 10459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:42.685333 10459 hybrid_clock.cc:648] HybridClock initialized: now 1786412622685251 us; error 32 us; skew 500 ppm
I20260811 01:43:42.685883 10459 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:42 dist-test-slave-0kls krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:42.689311 10459 init.cc:377] Logged in from keytab as kudu/127.17.132.62@KRBTEST.COM (short username kudu)
I20260811 01:43:42.690840 10459 webserver.cc:460] Webserver started at http://127.17.132.62:45379/ using document root <none> and password file <none>
I20260811 01:43:42.691636 10459 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:42.691788 10459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:42.692162 10459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:42.695452 10459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data/instance:
uuid: "d3bc9c61efd74bd599d1811f960b9a1c"
format_stamp: "Formatted at 2026-08-11 01:43:42 on dist-test-slave-0kls"
server_key: "233671fe1395a12960cb58d0dea693fd"
server_key_iv: "9e6c7985c0b556c47e12b67055bb05e6"
server_key_version: "encryptionkey@0"
I20260811 01:43:42.696305 10459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance:
uuid: "d3bc9c61efd74bd599d1811f960b9a1c"
format_stamp: "Formatted at 2026-08-11 01:43:42 on dist-test-slave-0kls"
server_key: "233671fe1395a12960cb58d0dea693fd"
server_key_iv: "9e6c7985c0b556c47e12b67055bb05e6"
server_key_version: "encryptionkey@0"
I20260811 01:43:42.701578 10459 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:43:42.705168 10475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:42.706578 10459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:42.706791 10459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal
uuid: "d3bc9c61efd74bd599d1811f960b9a1c"
format_stamp: "Formatted at 2026-08-11 01:43:42 on dist-test-slave-0kls"
server_key: "233671fe1395a12960cb58d0dea693fd"
server_key_iv: "9e6c7985c0b556c47e12b67055bb05e6"
server_key_version: "encryptionkey@0"
I20260811 01:43:42.707026 10459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:42.728557 10459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:42.732650 10459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:42.732930 10459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:42.752089 10459 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.62:38919
I20260811 01:43:42.752344 10529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.62:38919 every 8 connection(s)
I20260811 01:43:42.753861 10459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/data/info.pb
I20260811 01:43:42.754210 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10459
I20260811 01:43:42.754420 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-0/wal/instance
I20260811 01:43:42.755050 17936 external_mini_cluster.cc:1428] Setting key 091c5bd439bf8b034ae172faf48cb9d7
I20260811 01:43:42.758746 10530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:42.769055 10530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:42 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.132.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.61@KRBTEST.COM" created.
I20260811 01:43:42.795233 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.772925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:38919 (local address 127.0.0.1:54580)
0811 01:43:42.774002 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.774064 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:42.776054 (+ 1990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:42.777169 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:42.777183 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:42.777759 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:42.778178 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:42.778195 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:42.780615 (+ 2420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:42.780619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:42.781712 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:42.781726 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:42.783170 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:42.783175 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:42.783329 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:42.783994 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:42.784029 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:42.786304 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:42.790938 (+ 4634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:42.790949 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:42.790960 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:42.791433 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:42.791871 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:42.791874 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:42.791876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:42.792029 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:42.792911 (+ 882us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:42.792918 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:42.793182 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 01:43:42.793491 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 01:43:42.794260 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":253,"thread_start_us":433,"threads_started":1}
I20260811 01:43:42.795291 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.772924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54580 (local address 127.17.132.62:38919)
0811 01:43:42.774761 (+ 1837us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:42.774774 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:42.774834 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:43:42.776466 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:42.776477 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:42.776846 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:42.777089 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:42.778423 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:42.780456 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:42.781918 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:42.782931 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:42.783129 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:42.786619 (+ 3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:42.786633 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:42.786652 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:42.786702 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:42.790780 (+ 4078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:42.791591 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:42.791606 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:42.791609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:42.791769 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:42.792159 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:42.792162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:42.792164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:42.792746 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:42.792893 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:42.793645 (+ 752us) server_negotiation.cc:299] Negotiation successful
0811 01:43:42.793960 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":1591,"spinlock_wait_cycles":18816,"thread_start_us":1378,"threads_started":1}
I20260811 01:43:42.798278 10530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:42.799269 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.798895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60382)
0811 01:43:42.799058 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.799168 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 01:43:42.799489 10477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
I20260811 01:43:42.801188 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.800727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60394)
0811 01:43:42.800981 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.801063 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260811 01:43:42.801380 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:34975: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
Entry for principal kudu/127.17.132.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab.
I20260811 01:43:42.832881 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:34975
--webserver_interface=127.17.132.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:43:42.850739 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } attempt: 1
I20260811 01:43:42.852187 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.851538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60404)
0811 01:43:42.851817 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.851988 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:43:42.853377 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.852912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60414)
0811 01:43:42.853110 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.853204 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:43:42.853650 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:34975: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
I20260811 01:43:42.921960 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } attempt: 2
I20260811 01:43:42.923375 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.922744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60426)
0811 01:43:42.923069 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.923186 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 01:43:42.924599 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:42.924150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60438)
0811 01:43:42.924332 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:42.924415 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 01:43:42.924811 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:34975: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
I20260811 01:43:43.016115 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } attempt: 3
I20260811 01:43:43.017601 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.016934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60450)
0811 01:43:43.017236 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.017381 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260811 01:43:43.019001 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.018455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60464)
0811 01:43:43.018660 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.018774 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:43:43.019321 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:34975: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
I20260811 01:43:43.162647 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } attempt: 4
I20260811 01:43:43.164139 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.163383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60476)
0811 01:43:43.163801 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.163933 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
I20260811 01:43:43.165522 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.165039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60486)
0811 01:43:43.165232 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.165350 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 01:43:43.165841 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.61:34975: Network error: Client connection negotiation failed: client connection to 127.17.132.61:34975: connect: Connection refused (error 111)
W20260811 01:43:43.205190 10537 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:43.205590 10537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:43.205708 10537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:43.205866 10537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:43.213511 10537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:43.213622 10537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:43.213718 10537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:43.213826 10537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:43.213953 10537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:43.224404 10537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.61.keytab
--principal=kudu/127.17.132.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.61:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.132.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:43.225894 10537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:43.227360 10537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:43.241400 10542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:43.241885 10546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:43.241885 10543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:43.243129 10537 server_base.cc:1034] running on GCE node
I20260811 01:43:43.244055 10537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:43.245697 10537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:43.247033 10537 hybrid_clock.cc:648] HybridClock initialized: now 1786412623246951 us; error 39 us; skew 500 ppm
I20260811 01:43:43.247423 10537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:43.251101 10537 init.cc:377] Logged in from keytab as kudu/127.17.132.61@KRBTEST.COM (short username kudu)
I20260811 01:43:43.252919 10537 webserver.cc:460] Webserver started at http://127.17.132.61:43377/ using document root <none> and password file <none>
I20260811 01:43:43.253758 10537 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:43.253975 10537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:43.254369 10537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:43.257776 10537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data/instance:
uuid: "9fd4b42212c743dd9675a87a96e982ae"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "a74ca6707feee02ad359b331581bc6d1"
server_key_iv: "3dc2e8f90f493c5fdbb30dbfbeb66571"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.258795 10537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal/instance:
uuid: "9fd4b42212c743dd9675a87a96e982ae"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "a74ca6707feee02ad359b331581bc6d1"
server_key_iv: "3dc2e8f90f493c5fdbb30dbfbeb66571"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.265070 10537 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:43:43.269233 10553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:43.270913 10537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:43.271127 10537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal
uuid: "9fd4b42212c743dd9675a87a96e982ae"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "a74ca6707feee02ad359b331581bc6d1"
server_key_iv: "3dc2e8f90f493c5fdbb30dbfbeb66571"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.271380 10537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:43.304359 10537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:43.309002 10537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:43.309350 10537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:43.329406 10537 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.61:34975
I20260811 01:43:43.329443 10607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.61:34975 every 8 connection(s)
I20260811 01:43:43.330940 10537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/data/info.pb
I20260811 01:43:43.333263 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10537
I20260811 01:43:43.333523 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-1/wal/instance
I20260811 01:43:43.334218 17936 external_mini_cluster.cc:1428] Setting key 8d668c5a55c4ca00f973991b7231ecfb
I20260811 01:43:43.335155 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:43.342097 10608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:43.367264 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.344820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.17.132.62:38919)
0811 01:43:43.345422 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.345431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.346384 (+ 953us) server_negotiation.cc:407] Connection header received
0811 01:43:43.349148 (+ 2764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.349153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.349230 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.349337 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.351567 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.352380 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.354903 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.355364 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.355467 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.360381 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.360387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.360391 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.360441 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.363453 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.364607 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.364615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.364619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.364790 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.365308 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.365311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.365313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.365597 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.365712 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.366800 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.366980 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":313,"threads_started":1}
I20260811 01:43:43.368957 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.345318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:38919 (local address 127.0.0.1:54594)
0811 01:43:43.346205 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.346259 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.348765 (+ 2506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.349643 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.349658 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.350522 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.351320 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.351349 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.352571 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.352580 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.354724 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.354743 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.355626 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.355637 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.355972 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.356750 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.356786 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.360064 (+ 3278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.363647 (+ 3583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.363662 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.363687 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.364442 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.364918 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.364925 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.364929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.365189 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.365745 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.365757 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.366340 (+ 583us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.366715 (+ 375us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.367355 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":380,"threads_started":1}
WARNING: no policy specified for kudu/127.17.132.60@KRBTEST.COM; defaulting to no policy
I20260811 01:43:43.370860 10608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.132.60@KRBTEST.COM" created.
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:43.389374 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.371678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60492)
0811 01:43:43.371928 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.371955 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.372108 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.373382 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.373390 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.373992 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.374215 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.374231 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.375824 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.375833 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.377327 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.377346 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.378587 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.378596 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.378806 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.379465 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.379491 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.382328 (+ 2837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.386774 (+ 4446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.386781 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.386788 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.387320 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.387758 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.387761 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.387764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.387897 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.388664 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.388667 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.388780 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.388889 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.389098 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 01:43:43.389901 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.372080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60492 (local address 127.17.132.61:34975)
0811 01:43:43.372883 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.372890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.372917 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:43:43.372966 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.372972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.373208 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.373341 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.374434 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.375681 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.377492 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.378402 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.378534 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.382562 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.382587 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.382609 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.382652 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.386624 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.387463 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.387474 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.387479 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.387638 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.388011 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.388016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.388018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.388537 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.388763 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.389071 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.389385 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":466,"threads_started":1}
I20260811 01:43:43.392288 10608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:43.393714 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.393082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52454)
0811 01:43:43.393335 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.393505 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260811 01:43:43.394105 10556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.395836 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.395400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52470)
0811 01:43:43.395584 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.395691 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 01:43:43.396097 10608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
Entry for principal kudu/127.17.132.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab.
I20260811 01:43:43.414667 17936 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
/tmp/dist-test-taskFNFd6P/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:41743
--webserver_interface=127.17.132.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.132.20:37303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:43:43.445478 10608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 1
I20260811 01:43:43.446923 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.446282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52484)
0811 01:43:43.446555 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.446704 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 01:43:43.448179 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.447689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52498)
0811 01:43:43.447898 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.448013 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:43:43.448477 10608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.465147 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } attempt: 5
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:43.487143 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.466029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60508)
0811 01:43:43.466274 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.466304 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.466420 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.466873 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.466877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.467272 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.467460 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.467469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.468927 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.468931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.469851 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.469873 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.470887 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.470891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.471152 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.477992 (+ 6840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.478015 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.480593 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.484532 (+ 3939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.484537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.484540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.484979 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.485467 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.485472 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.485475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.485647 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.486338 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.486342 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.486489 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.486641 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.486882 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 01:43:43.487329 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.466177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60508 (local address 127.17.132.61:34975)
0811 01:43:43.466389 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.466396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.466421 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:43:43.466550 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.466555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.466670 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.466787 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.467628 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.468783 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.470011 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.470723 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.470863 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.480878 (+ 10015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.480886 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.480890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.480936 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.484349 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.485125 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.485131 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.485134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.485291 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.485775 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.485780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.485808 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.486203 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.486355 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.486776 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.487024 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:43:43.488391 10530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:43.489576 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.489101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52502)
0811 01:43:43.489301 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.489400 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 01:43:43.490716 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.490333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52512)
0811 01:43:43.490494 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.490594 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:43:43.490947 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.516760 10608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 2
I20260811 01:43:43.518030 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.517514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52518)
0811 01:43:43.517723 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.517875 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 01:43:43.519069 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.518756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52524)
0811 01:43:43.518894 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.518963 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:43:43.519335 10608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.542193 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 1
I20260811 01:43:43.543617 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.542952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52526)
0811 01:43:43.543225 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.543361 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:43:43.544802 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.544408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52532)
0811 01:43:43.544568 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.544658 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:43:43.545030 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.610594 10608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 3
I20260811 01:43:43.611960 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.611472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52546)
0811 01:43:43.611703 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.611799 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 01:43:43.613255 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.612794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52550)
0811 01:43:43.613046 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.613149 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 01:43:43.613255 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 2
W20260811 01:43:43.613536 10608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.614464 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.613922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52560)
0811 01:43:43.614169 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.614268 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:43:43.615468 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.615105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52572)
0811 01:43:43.615262 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.615344 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 01:43:43.615700 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.721948 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 3
I20260811 01:43:43.723186 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.722701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52578)
0811 01:43:43.722914 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.723008 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:43:43.724299 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.723892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52594)
0811 01:43:43.724116 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.724194 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 01:43:43.724506 10530 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
I20260811 01:43:43.756822 10608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 4
I20260811 01:43:43.758019 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.757476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52598)
0811 01:43:43.757724 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.757861 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:43:43.759045 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.758716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52604)
0811 01:43:43.758877 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.758951 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 01:43:43.759312 10608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.132.60:41743: Network error: Client connection negotiation failed: client connection to 127.17.132.60:41743: connect: Connection refused (error 111)
W20260811 01:43:43.781391 10616 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:43:43.781787 10616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:43:43.781957 10616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:43:43.782091 10616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:43:43.789660 10616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:43:43.789775 10616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:43:43.789863 10616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:43:43.789973 10616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:43:43.790068 10616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:43:43.800529 10616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.132.20:37303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.132.62:38919,127.17.132.61:34975,127.17.132.60:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/krb5kdc/kudu_127.17.132.60.keytab
--principal=kudu/127.17.132.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.132.60:41743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.132.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:43:43.802037 10616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:43:43.803474 10616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:43:43.816151 10626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:43.816253 10622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:43:43.816253 10621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:43:43.817261 10616 server_base.cc:1034] running on GCE node
I20260811 01:43:43.818209 10616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:43:43.819773 10616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:43:43.821017 10616 hybrid_clock.cc:648] HybridClock initialized: now 1786412623820944 us; error 35 us; skew 500 ppm
I20260811 01:43:43.821412 10616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:43:43.824692 10616 init.cc:377] Logged in from keytab as kudu/127.17.132.60@KRBTEST.COM (short username kudu)
I20260811 01:43:43.826378 10616 webserver.cc:460] Webserver started at http://127.17.132.60:35685/ using document root <none> and password file <none>
I20260811 01:43:43.827118 10616 fs_manager.cc:359] Metadata directory not provided
I20260811 01:43:43.827229 10616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:43:43.827517 10616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:43:43.830729 10616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data/instance:
uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "27b1420a05416fc83b82e412b8f83acf"
server_key_iv: "a6d6b45af72fd9658621f97e085c1200"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.831557 10616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal/instance:
uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "27b1420a05416fc83b82e412b8f83acf"
server_key_iv: "a6d6b45af72fd9658621f97e085c1200"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.837137 10616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:43:43.841040 10633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:43:43.842846 10616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:43:43.843067 10616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data,/tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal
uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2"
format_stamp: "Formatted at 2026-08-11 01:43:43 on dist-test-slave-0kls"
server_key: "27b1420a05416fc83b82e412b8f83acf"
server_key_iv: "a6d6b45af72fd9658621f97e085c1200"
server_key_version: "encryptionkey@0"
I20260811 01:43:43.843389 10616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:43:43.861732 10616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:43:43.866453 10616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:43:43.866776 10616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:43:43.887344 10616 rpc_server.cc:307] RPC server started. Bound to: 127.17.132.60:41743
I20260811 01:43:43.887410 10686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.132.60:41743 every 8 connection(s)
I20260811 01:43:43.888916 10616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/data/info.pb
I20260811 01:43:43.889582 17936 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu as pid 10616
I20260811 01:43:43.889851 17936 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskFNFd6P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786412236095684-17936-0/minicluster-data/master-2/wal/instance
I20260811 01:43:43.890522 17936 external_mini_cluster.cc:1428] Setting key 0d9b68202f6b45e211a8ce3892d210e5
I20260811 01:43:43.894394 10687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:43:43.901746 10530 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 4
I20260811 01:43:43.904870 10687 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.62@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
I20260811 01:43:43.920423 10691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.892768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52610 (local address 127.17.132.60:41743)
0811 01:43:43.893654 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.893666 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.893710 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:43:43.895540 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.895564 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.895973 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.896312 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.898409 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.900009 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.902147 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.903394 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.903716 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.909352 (+ 5636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.909364 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.909382 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.909436 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.913804 (+ 4368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.914788 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.914802 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.914814 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.915352 (+ 538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.915803 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.915808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.915812 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.916864 (+ 1052us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.917239 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.918244 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.918785 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":410,"threads_started":1}
I20260811 01:43:43.921135 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.902771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52616 (local address 127.17.132.60:41743)
0811 01:43:43.903773 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.903781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.903805 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:43:43.903859 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.903864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.903945 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.904071 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.905254 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.906777 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.909212 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.909984 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.910151 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.914385 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.914390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.914393 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.914422 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.917730 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.918816 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.918820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.918822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.918952 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.919430 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.919435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.919438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.919837 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.919968 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.920488 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.920684 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":833,"thread_start_us":641,"threads_started":1}
I20260811 01:43:43.922447 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.902592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52616)
0811 01:43:43.902922 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.902944 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.903113 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.904226 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.904231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.904775 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.904996 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.905011 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.906970 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.906976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.908368 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.908396 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.910166 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.910172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.910431 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.911133 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.911163 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.914153 (+ 2990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.917942 (+ 3789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.917950 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.917956 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.918482 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.919103 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.919109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.919113 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.919306 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.919995 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.920000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.920222 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.920382 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.922018 (+ 1636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182}
I20260811 01:43:43.928615 10530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: Bootstrap starting.
I20260811 01:43:43.930192 10693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.908136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.17.132.62:38919)
0811 01:43:43.909004 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.909012 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.909769 (+ 757us) server_negotiation.cc:407] Connection header received
0811 01:43:43.909870 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.909875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.909958 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.910085 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.912121 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.913121 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.915286 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.916016 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.916170 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.920238 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.920245 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.920249 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.920291 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.924221 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.925346 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.925355 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.925361 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.925570 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.926176 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.926184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.926190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.926759 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.926948 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.929058 (+ 2110us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.929411 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":564,"threads_started":1}
I20260811 01:43:43.930627 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.908197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.62:38919 (local address 127.0.0.1:54610)
0811 01:43:43.909381 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.909436 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.909639 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.910351 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.910361 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.911509 (+ 1148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.911968 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.911982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.913333 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.913343 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.915105 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.915120 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.916232 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.916240 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.916465 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.917138 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.917163 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.920009 (+ 2846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.924397 (+ 4388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.924409 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.924416 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.925138 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.925740 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.925748 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.925754 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.925997 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.927061 (+ 1064us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.927074 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.927342 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.927589 (+ 247us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.928097 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":727,"threads_started":1}
I20260811 01:43:43.932482 10530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:43.934190 10530 log.cc:824] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:43.935467 10687 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:43.939742 10530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: No bootstrap required, opened a new log
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.62@KRBTEST.COM
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:43.951596 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.936354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.61:34975 (local address 127.0.0.1:60516)
0811 01:43:43.936565 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.936581 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.936672 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.937158 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.937162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.937687 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.937928 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.937942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.939356 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.939362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.940922 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.940942 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.942034 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.942041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.942252 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.942835 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.942879 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.945255 (+ 2376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.948695 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.948701 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.948705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.949335 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.949754 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.949759 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.949763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.949950 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.950579 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.950587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.950766 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.950933 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.951223 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:43:43.951710 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.936648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60516 (local address 127.17.132.61:34975)
0811 01:43:43.936834 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.936840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.936858 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:43:43.936918 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.936925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.937007 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.937114 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.938111 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.939164 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.941139 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.941852 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.941988 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.945473 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.945478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.945481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.945524 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.948546 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.949464 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.949470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.949474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.949631 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.950072 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.950078 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.950081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.950420 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.950616 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.951057 (+ 441us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.951315 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:43:43.951786 10530 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:43.952243 10530 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3bc9c61efd74bd599d1811f960b9a1c, State: Initialized, Role: FOLLOWER
I20260811 01:43:43.952804 10530 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:43.953313 10687 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:43:43.954048 10693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.924342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54614 (local address 127.17.132.62:38919)
0811 01:43:43.931733 (+ 7391us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.931742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.931768 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:43:43.931845 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.931854 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.931995 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.932152 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.934093 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.935524 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.937436 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.938183 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.938326 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.943736 (+ 5410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.943743 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.943747 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.943787 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.947883 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.948860 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.948867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.948870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.949032 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.949550 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.949561 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.949565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.950047 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.950341 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.951427 (+ 1086us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.951679 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7234,"thread_start_us":9729,"threads_started":1}
I20260811 01:43:43.954056 10697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:43.954955 10697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:43.955617 10530 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.60@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
Aug 11 01:43:43 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.132.61@KRBTEST.COM
I20260811 01:43:43.970283 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.954157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52620)
0811 01:43:43.954740 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:43.954758 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:43.954932 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:43.955436 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:43.955440 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:43.955982 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:43.956211 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.956226 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.957624 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.957629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.959625 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:43.959655 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.960350 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.960355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:43.960567 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.961219 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:43.961245 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:43.963918 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:43.967205 (+ 3287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.967211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.967215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.967582 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.967961 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:43.967967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:43.967971 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:43.968109 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:43.969093 (+ 984us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:43.969098 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:43.969263 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 01:43:43.969439 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 01:43:43.969847 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326}
I20260811 01:43:43.971202 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.954467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52620 (local address 127.17.132.60:41743)
0811 01:43:43.954625 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.954632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.954832 (+ 200us) server_negotiation.cc:407] Connection header received
0811 01:43:43.955063 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.955069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.955160 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.955231 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.956381 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.957470 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.959807 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.960196 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.960325 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.964114 (+ 3789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.964121 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.964126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.964167 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.967059 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.967706 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.967714 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.967717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.967852 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.968369 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.968375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.968379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.968860 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.969023 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.970611 (+ 1588us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.970873 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:43:43.977887 10687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: Bootstrap starting.
I20260811 01:43:43.978430 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:43.956151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60530 (local address 127.17.132.61:34975)
0811 01:43:43.956637 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:43.956643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:43.956660 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:43:43.956722 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:43.956727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:43.956804 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:43.956900 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:43.959489 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.960968 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.962960 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:43.963909 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:43.964076 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:43.970674 (+ 6598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:43.970681 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:43.970686 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:43.970730 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:43.974481 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.975548 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.975555 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.975568 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.975739 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:43.976285 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:43.976290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:43.976295 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:43.976727 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:43.977016 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:43.977727 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 01:43:43.978024 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350}
I20260811 01:43:43.981510 10687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: Neither blocks nor log segments found. Creating new log.
I20260811 01:43:43.982991 10687 log.cc:824] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: Log is configured to *not* fsync() on all Append() calls
W20260811 01:43:43.985984 10482 tablet.cc:2369] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:43:43.986919 10687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: No bootstrap required, opened a new log
I20260811 01:43:43.987205 17936 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 01:43:43.987404 10708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:43:43.987803 10708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:43:43.978189 10459 master_runner.cc:186] Error getting master registration for 127.17.132.61:34975: OK, instance_id { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" instance_seqno: 1786412623323750 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:43:43.989995 10459 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:43:43.990411 10505 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d3bc9c61efd74bd599d1811f960b9a1c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54614
I20260811 01:43:43.990804 10505 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:43:43.991034 10505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:43.994693 10505 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:43.996837 10505 leader_election.cc:288] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [CANDIDATE]: Term 1 election: Requested vote from peers 9fd4b42212c743dd9675a87a96e982ae (127.17.132.61:34975), 32dcc9c78f5e4c32ac6d2540fa1aabb2 (127.17.132.60:41743)
I20260811 01:43:43.997925 10687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:43.998374 10687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32dcc9c78f5e4c32ac6d2540fa1aabb2, State: Initialized, Role: FOLLOWER
I20260811 01:43:43.998962 10687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:44.002717 10687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:44.009385 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2"
I20260811 01:43:44.010100 10661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:44.019059 10661 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3bc9c61efd74bd599d1811f960b9a1c in term 1.
I20260811 01:43:44.020334 10479 leader_election.cc:302] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32dcc9c78f5e4c32ac6d2540fa1aabb2, d3bc9c61efd74bd599d1811f960b9a1c; no voters:
I20260811 01:43:44.020943 10697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:43:44.001370 10713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.030256 10697 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [term 1 LEADER]: Becoming Leader. State: Replica: d3bc9c61efd74bd599d1811f960b9a1c, State: Running, Role: LEADER
I20260811 01:43:44.031484 10697 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:44.034664 10713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.046053 10720 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3bc9c61efd74bd599d1811f960b9a1c. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.046561 10720 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:44.058532 10608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } attempt: 5
I20260811 01:43:44.064416 10727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:43:44.066917 10727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 01:43:44 dist-test-slave-0kls krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412623, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.132.61@KRBTEST.COM for kudu/127.17.132.60@KRBTEST.COM
I20260811 01:43:44.093556 10693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:44.047090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.17.132.62:38919)
0811 01:43:44.047453 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.047461 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.052145 (+ 4684us) server_negotiation.cc:407] Connection header received
0811 01:43:44.052775 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.052785 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.052903 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.052998 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.058260 (+ 5262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.059478 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.067183 (+ 7705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.067911 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.068047 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:44.075517 (+ 7470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:44.075531 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:44.075537 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:44.075582 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:44.080638 (+ 5056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.088080 (+ 7442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.088091 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.088097 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.088345 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.089742 (+ 1397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.089751 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.089757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.090327 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:44.090666 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:44.091954 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0811 01:43:44.092389 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 01:43:44.093968 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:44.046834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52632 (local address 127.17.132.60:41743)
0811 01:43:44.047106 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.047115 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.061093 (+ 13978us) server_negotiation.cc:407] Connection header received
0811 01:43:44.064494 (+ 3401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.064501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.064609 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.064691 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.069913 (+ 5222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.071073 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.073253 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.073968 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.074116 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:44.085290 (+ 11174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:44.085301 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:44.085307 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:44.085361 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:44.089882 (+ 4521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.090803 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.090810 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.090815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.090986 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.091468 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.091473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.091478 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.091861 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:44.092180 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:44.093206 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0811 01:43:44.093445 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:43:44.099481 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:44.061278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60538 (local address 127.17.132.61:34975)
0811 01:43:44.061501 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.061509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.078358 (+ 16849us) server_negotiation.cc:407] Connection header received
0811 01:43:44.081377 (+ 3019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.081384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.081474 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.081553 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.083898 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.085116 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.087241 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.087992 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.088121 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:44.091681 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:44.091688 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:44.091692 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:44.091735 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:44.095570 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.096659 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.096666 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.096669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.096853 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.097390 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.097395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.097398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.097888 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:44.098156 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:44.098776 (+ 620us) server_negotiation.cc:299] Negotiation successful
0811 01:43:44.099121 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:43:44.104619 10611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:44.059179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.132.60:41743 (local address 127.0.0.1:52640)
0811 01:43:44.059627 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 01:43:44.059648 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:43:44.059784 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:43:44.060825 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:43:44.060834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:43:44.061629 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:43:44.061974 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:44.061994 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.064161 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.064170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:44.066076 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:43:44.066094 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.067697 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.067707 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:43:44.068047 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:44.069286 (+ 1239us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:43:44.069345 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:43:44.073899 (+ 4554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:43:44.100306 (+ 26407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:44.100314 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:44.100321 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:44.101121 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:44.102084 (+ 963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:43:44.102089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:43:44.102093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:43:44.102274 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:43:44.103190 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:43:44.103198 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:43:44.103429 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 01:43:44.103624 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 01:43:44.104072 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287}
I20260811 01:43:44.106675 10661 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [term 1 FOLLOWER]: Refusing update from remote peer d3bc9c61efd74bd599d1811f960b9a1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:43:44.106756 10736 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:43:44.108471 10720 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:43:44.109318 10691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:44.060006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52640 (local address 127.17.132.60:41743)
0811 01:43:44.060216 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.060225 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.060249 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:43:44.060337 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.060345 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.060453 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.060576 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.062336 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.063875 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.066300 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:44.067234 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:44.067390 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:44.074452 (+ 7062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:43:44.074460 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:43:44.074464 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:43:44.074507 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:43:44.100134 (+ 25627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.101422 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.101433 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.101439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.101935 (+ 496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:43:44.102424 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:43:44.102432 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:43:44.102438 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:43:44.102970 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:43:44.108454 (+ 5484us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:44.108627 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 01:43:44.108954 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 01:43:44.115026 10608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: Bootstrap starting.
I20260811 01:43:44.119377 10608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: Neither blocks nor log segments found. Creating new log.
W20260811 01:43:44.119378 10639 tablet.cc:2369] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:43:44.120971 10608 log.cc:824] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: Log is configured to *not* fsync() on all Append() calls
I20260811 01:43:44.125933 10608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: No bootstrap required, opened a new log
I20260811 01:43:44.113330 10616 master_runner.cc:186] Error getting master registration for 127.17.132.61:34975: OK, instance_id { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" instance_seqno: 1786412623323750 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:43:44.132550 10616 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:43:44.138945 10608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:44.139477 10608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd4b42212c743dd9675a87a96e982ae, State: Initialized, Role: FOLLOWER
I20260811 01:43:44.140175 10608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } }
I20260811 01:43:44.141837 10741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.142781 10741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.143194 10608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:43:44.143260 10582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9fd4b42212c743dd9675a87a96e982ae"
I20260811 01:43:44.143373 10713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3bc9c61efd74bd599d1811f960b9a1c. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.143657 10713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.143776 10582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:43:44.149680 10582 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3bc9c61efd74bd599d1811f960b9a1c in term 1.
I20260811 01:43:44.149591 10697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.149993 10697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:44.150887 10580 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [term 1 FOLLOWER]: Refusing update from remote peer d3bc9c61efd74bd599d1811f960b9a1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:43:44.154508 10720 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:43:44.159086 10713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.159400 10713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.162544 10727 catalog_manager.cc:1347] Generated new cluster ID: 8cc6d488f338406599b5d8c8c6a6837a
I20260811 01:43:44.162669 10727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:43:44.187402 10747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.187855 10747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.188198 10741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3bc9c61efd74bd599d1811f960b9a1c. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.188442 10741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:43:44.208488 10720 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3bc9c61efd74bd599d1811f960b9a1c" member_type: VOTER last_known_addr { host: "127.17.132.62" port: 38919 } } peers { permanent_uuid: "9fd4b42212c743dd9675a87a96e982ae" member_type: VOTER last_known_addr { host: "127.17.132.61" port: 34975 } } peers { permanent_uuid: "32dcc9c78f5e4c32ac6d2540fa1aabb2" member_type: VOTER last_known_addr { host: "127.17.132.60" port: 41743 } } }
I20260811 01:43:44.208811 10720 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c [sys.catalog]: This master's current role is: LEADER
I20260811 01:43:44.219038 10727 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:43:44.221342 10727 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:43:44.229131 10759 catalog_manager.cc:1259] Loaded cluster ID: 8cc6d488f338406599b5d8c8c6a6837a
I20260811 01:43:44.229327 10759 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: loading cluster ID for follower catalog manager: success
I20260811 01:43:44.232949 10759 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: acquiring CA information for follower catalog manager: success
W20260811 01:43:44.235594 10759 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 01:43:44.243294 10727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3bc9c61efd74bd599d1811f960b9a1c: Generated new TSK 0
I20260811 01:43:44.244521 10727 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:43:44.366349 10693 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.363203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54634 (local address 127.17.132.62:38919)
0811 01:43:44.363445 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.363453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.364293 (+ 840us) server_negotiation.cc:407] Connection header received
0811 01:43:44.364610 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.364616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.364712 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.364790 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.366068 (+ 1278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54634: BlockingRecv error: recv got EOF from 127.0.0.1:54634 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 01:43:44.368884 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.364727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60550 (local address 127.17.132.61:34975)
0811 01:43:44.364925 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.364933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.367157 (+ 2224us) server_negotiation.cc:407] Connection header received
0811 01:43:44.367417 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.367423 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.367546 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.367621 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.368637 (+ 1016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60550: BlockingRecv error: recv got EOF from 127.0.0.1:60550 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 01:43:44.377025 10691 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.365548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52642 (local address 127.17.132.60:41743)
0811 01:43:44.365808 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.365816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.369578 (+ 3762us) server_negotiation.cc:407] Connection header received
0811 01:43:44.373945 (+ 4367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.373952 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.374045 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.374126 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.376738 (+ 2612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52642: BlockingRecv error: recv got EOF from 127.0.0.1:52642 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260811 01:43:44.438676 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.429815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60554 (local address 127.17.132.61:34975)
0811 01:43:44.430049 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.430058 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.436332 (+ 6274us) server_negotiation.cc:407] Connection header received
0811 01:43:44.436742 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.436750 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.436904 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.437039 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.438238 (+ 1199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60554: BlockingRecv error: recv got EOF from 127.0.0.1:60554 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260811 01:43:44.465478 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.463297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.17.132.61:34975)
0811 01:43:44.463551 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.463558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.463656 (+ 98us) server_negotiation.cc:407] Connection header received
0811 01:43:44.463971 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.463979 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.464093 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.464174 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.465239 (+ 1065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60560: BlockingRecv error: recv got EOF from 127.0.0.1:60560 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 01:43:44.515543 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.502289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60576 (local address 127.17.132.61:34975)
0811 01:43:44.502476 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.502482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.513168 (+ 10686us) server_negotiation.cc:407] Connection header received
0811 01:43:44.513764 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.513771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.513922 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.514015 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.515234 (+ 1219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60576: BlockingRecv error: recv got EOF from 127.0.0.1:60576 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 01:43:44.567946 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.554755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.17.132.61:34975)
0811 01:43:44.555005 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.555011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.565758 (+ 10747us) server_negotiation.cc:407] Connection header received
0811 01:43:44.566353 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.566360 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.566461 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.566542 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.567675 (+ 1133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60580: BlockingRecv error: recv got EOF from 127.0.0.1:60580 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
W20260811 01:43:44.625590 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.612263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.17.132.61:34975)
0811 01:43:44.612485 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.612494 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.623533 (+ 11039us) server_negotiation.cc:407] Connection header received
0811 01:43:44.623931 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.623938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.624051 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.624152 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.625297 (+ 1145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60590: BlockingRecv error: recv got EOF from 127.0.0.1:60590 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:43:44.709088 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.680201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.17.132.61:34975)
0811 01:43:44.680405 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.680411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.706487 (+ 26076us) server_negotiation.cc:407] Connection header received
0811 01:43:44.706769 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.706781 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.706914 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.707002 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.708808 (+ 1806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60606: BlockingRecv error: recv got EOF from 127.0.0.1:60606 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 01:43:44.799110 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.779537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60622 (local address 127.17.132.61:34975)
0811 01:43:44.779785 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.779795 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.797450 (+ 17655us) server_negotiation.cc:407] Connection header received
0811 01:43:44.797715 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.797721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.797882 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.798003 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.798826 (+ 823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60622: BlockingRecv error: recv got EOF from 127.0.0.1:60622 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 01:43:44.869141 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:44.866760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.17.132.61:34975)
0811 01:43:44.867042 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:44.867052 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:44.867509 (+ 457us) server_negotiation.cc:407] Connection header received
0811 01:43:44.867738 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:44.867743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:44.867822 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:44.867912 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:44.868910 (+ 998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60638: BlockingRecv error: recv got EOF from 127.0.0.1:60638 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260811 01:43:45.002955 10613 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:43:45.000752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60646 (local address 127.17.132.61:34975)
0811 01:43:45.001011 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.001019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.001353 (+ 334us) server_negotiation.cc:407] Connection header received
0811 01:43:45.001489 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.001493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.001624 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.001745 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:43:45.002656 (+ 911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60646: BlockingRecv error: recv got EOF from 127.0.0.1:60646 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:43:45.112658 10736 catalog_manager.cc:1259] Loaded cluster ID: 8cc6d488f338406599b5d8c8c6a6837a
I20260811 01:43:45.112775 10736 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: loading cluster ID for follower catalog manager: success
I20260811 01:43:45.115592 10736 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: acquiring CA information for follower catalog manager: success
I20260811 01:43:45.117727 10736 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 32dcc9c78f5e4c32ac6d2540fa1aabb2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:43:45.239205 10759 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9fd4b42212c743dd9675a87a96e982ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:43:45.270637 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:45.263465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.17.132.61:34975)
0811 01:43:45.263657 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.263662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.263913 (+ 251us) server_negotiation.cc:407] Connection header received
0811 01:43:45.264230 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.264235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.264399 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.264498 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:45.265061 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.265945 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.268045 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.268479 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.268585 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:45.269241 (+ 656us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:45.269876 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:45.269992 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:45.270207 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 01:43:45.270289 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:43:45.285807 10831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:45.277492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.17.132.60:41743)
0811 01:43:45.278946 (+ 1454us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.278953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.278973 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:43:45.279107 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.279113 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.279334 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.279529 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:45.280145 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.281437 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.282861 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.283554 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.283678 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:45.284275 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:45.285055 (+ 780us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:45.285215 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:45.285331 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 01:43:45.285425 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1306,"thread_start_us":1128,"threads_started":1}
I20260811 01:43:45.301362 10831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:45.292762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52668 (local address 127.17.132.60:41743)
0811 01:43:45.292951 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.292957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.294274 (+ 1317us) server_negotiation.cc:407] Connection header received
0811 01:43:45.294528 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.294534 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.294621 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.294687 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:45.295557 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.296756 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.299012 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.299671 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.299795 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:45.300482 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:45.300633 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:45.300698 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:45.300940 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 01:43:45.301027 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:43:45.305146 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:45.292810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.17.132.62:38919)
0811 01:43:45.293825 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.293835 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.293863 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:43:45.294008 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.294013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.294288 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.294488 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:45.295374 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.296859 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.299922 (+ 3063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.300790 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.300941 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:45.301940 (+ 999us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:45.304402 (+ 2462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:45.304557 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:45.304684 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:43:45.304780 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":682,"threads_started":1}
I20260811 01:43:45.308668 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:43:45.294730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.17.132.61:34975)
0811 01:43:45.294940 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:43:45.294946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:43:45.302375 (+ 7429us) server_negotiation.cc:407] Connection header received
0811 01:43:45.302637 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:43:45.302643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:43:45.302729 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:43:45.302790 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:43:45.303405 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.304449 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.306363 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:43:45.306962 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:43:45.307119 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:43:45.307893 (+ 774us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:43:45.308020 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:43:45.308119 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:43:45.308295 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 01:43:45.308380 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:43:45.310002 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10459
I20260811 01:43:45.311173 10525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:45.428328 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10459
I20260811 01:43:45.455281 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10537
I20260811 01:43:45.456650 10603 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:45.569762 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10537
I20260811 01:43:45.597666 17936 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu pid 10616
I20260811 01:43:45.599035 10681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:43:45.710664 17936 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskFNFd6P/build/asan/bin/kudu with pid 10616
2026-08-11T01:43:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4979 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9989 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (389578 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST